-- Logs begin at Wed 2022-05-04 13:04:44 UTC, end at Wed 2022-05-04 14:21:00 UTC. -- May 04 13:39:58.407782 dv-cinder-836996-12-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 13:39:58.417662 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 13:39:58 2022] *** May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: nodename: dv-cinder-836996-12-iscsi May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: machine: x86_64 May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: clock source: unix May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: pcre jit disabled May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: detected number of CPU cores: 4 May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: current working directory: / May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: detected binary path: /usr/bin/uwsgi-core May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: your processes number limit is 47680 May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: your memory page size is 4096 bytes May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: detected max file descriptor number: 2048 May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: lock engine: pthread robust mutexes May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: thunder lock: enabled May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 13:39:58.420452 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 13:39:58.467177 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: Python main interpreter initialized at 0x55d4350169c0 May 04 13:39:58.467177 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: python threads support enabled May 04 13:39:58.467177 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: your server socket listen backlog is limited to 100 connections May 04 13:39:58.467177 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: your mercy for graceful operations on workers is 90 seconds May 04 13:39:58.467599 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: mapped 403077 bytes (393 KB) for 2 cores May 04 13:39:58.467689 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: *** Operational MODE: preforking *** May 04 13:39:58.467920 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: *** uWSGI is running in multiple interpreter mode *** May 04 13:39:58.467920 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: spawned uWSGI master process (pid: 91838) May 04 13:39:58.468134 dv-cinder-836996-12-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 13:39:58.473279 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: spawned uWSGI worker 1 (pid: 91848, cores: 1) May 04 13:39:58.473279 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: spawned uWSGI worker 2 (pid: 91849, cores: 1) May 04 13:39:58.473279 dv-cinder-836996-12-iscsi devstack@keystone.service[91838]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 13:40:04.413922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 13:40:04.413922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: from cryptography.utils import int_from_bytes May 04 13:40:04.414741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 13:40:04.414741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: from cryptography.utils import int_from_bytes May 04 13:40:04.417068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 13:40:04.417068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: from cryptography.utils import int_from_bytes May 04 13:40:04.417620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 13:40:04.417620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: from cryptography.utils import int_from_bytes May 04 13:40:04.465291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 13:40:04.465502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 13:40:04.465685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] command line args: [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 13:40:04.465837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 13:40:04.465959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 13:40:04.466045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 13:40:04.466126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ================================================================================ {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 13:40:04.466204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] command line args: [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 13:40:04.466385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] admin_token = **** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.466474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 13:40:04.466643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ================================================================================ {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 13:40:04.466726 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] config_dir = [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.466836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.466920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] admin_token = **** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.467022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] config_source = [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.467144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] config_dir = [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.467227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] debug = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.467336 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.467424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.467875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] config_source = [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.467875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] debug = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.468923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] list_limit = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] log_config_append = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] list_limit = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] log_dir = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] log_config_append = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] log_file = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] log_dir = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.469985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] log_file = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470381 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.470790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.471945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472382 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.472997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.473158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.473369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] publish_errors = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.473520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.473643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.473760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] publish_errors = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.473872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.473991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.474110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.474228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.474341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.475038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.475247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.475374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.475532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] standard_threads = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.475672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.475785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.475904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] standard_threads = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] use_journal = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] use_json = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] use_stderr = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.476983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] use_journal = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.477102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] use_syslog = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.477216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] use_json = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.477216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] use_stderr = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.477473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.477593 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] use_syslog = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.477714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.477833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:40:04.477946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.478066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.478185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.478300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.478417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.478536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.478653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.479027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.479147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.479266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.479385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.479497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.479615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.479807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.479924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.480976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.481095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.481216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.481349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.481463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.481574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.481696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.481810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.481935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.482967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.483957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.484905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.485016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.485136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.485306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.485431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.485552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.485672 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.485785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.485905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486245 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.486932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.487051 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.487167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.487400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.487525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.487651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.487766 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.487878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.487991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.488103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.488217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.488340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.488440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.488557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.488671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.488789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.488910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.489033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.489153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.489291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.489413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.489538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.489660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.489775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.489894 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.490020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.490165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.490331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.490604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.490728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.490851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.490964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.491077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.491197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.491321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.491437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.491549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.491662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.491774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.491887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.492007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.492122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.492241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.492356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.492469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.492589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.492778 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.492894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.493008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.493129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.493354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.493487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.493603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.493725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.493840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.493953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.494065 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.494186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.494397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.494530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.494653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.494768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.494880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.494993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.495163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.495290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.495503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.495619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.495731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.495842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.495954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.496066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.496187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.496301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.496419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.496543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.496658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.496770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.496892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.497946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.498990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.499979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.500935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.501918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] auth.external = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502894 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] auth.external = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.502974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] auth.password = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] auth.token = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] auth.password = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] auth.token = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503813 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.503995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] credential.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.504908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] credential.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.505086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.505160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.505365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.505440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.505665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.505776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.505891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.505960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.506114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.506244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.506415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.506521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.506687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.506798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.506946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.507054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.507187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.507292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.507444 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.507557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.507734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.507841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.507985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.508092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.508255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.508361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.508514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.508621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.508753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] federation.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.508856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.508997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.509103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] federation.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.509252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.509359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.509509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.509621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.509732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.509829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.509979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.510099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.510222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.510297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.510463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.510544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.510707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.510827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.510941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.511981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.512103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.512225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.512341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.512463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.512577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.512689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.512804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.512917 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.513031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.513145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.513359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.513491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.513609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.513723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.513837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.513952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.514066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.514187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.514303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.514418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.514532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.514646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.514760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.514962 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.515081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.515196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.515495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.515622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.515737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.515860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.515984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.516107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.516223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.516338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.516451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.516574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.516733 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.516926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.517116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.517334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.517517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.517714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.517900 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.518114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.518247 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.518363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.518599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.518732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.518856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.518971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.519085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.519198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.519311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.519439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.519555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.519671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.519785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.519899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.520941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.521065 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.521844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.521987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.522103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.522232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.522349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.522463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.522584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.522701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.522816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.522939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523740 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.523978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.524191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.524349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.524499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.524623 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.524740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.524854 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.524968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.525092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.525207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.525207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.525437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.525551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.525664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.525791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.525908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526143 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526502 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.526959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527304 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.527994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.528108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.528222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.528416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.528532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.528646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.528760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.528873 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.528986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.529109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.529224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.529413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.529528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.529641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.529754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.529880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.529996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.530110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.530224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.530338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.530452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.530573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.530689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.530802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.530915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531381 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.531959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.532074 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.532187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.532301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.532414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.532527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.532648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.532801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.532924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.533099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.533331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.533448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.533577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.533696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.533810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.533923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] resource.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] resource.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534617 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.534966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.535082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.535197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.535310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.535425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.535539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.535662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.535777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.535891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.536005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.536119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.536233 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.536355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.536473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.536587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.536700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] role.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.536861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] role.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.537581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] role.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.537720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] role.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.537838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.537953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.538067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.538182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.538296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.538420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.538539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.538654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.538769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.538883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.539927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.540858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.541080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.541080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.541324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.541442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.541557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.541677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.541800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.541916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.542950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.543064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.543187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.543302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.543417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.543538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.543654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.543770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.543893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.544935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.545049 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.545172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.545357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.545476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] token.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.545590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.545704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.545816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] token.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.545940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.546978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.547098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.547214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.547336 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.547451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.547565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.547678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.547792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.547905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.548955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.549069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.549182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.549312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.549440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.549557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.549671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.connection = **** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.549794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.549997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.550116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.connection = **** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.550240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.550364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.550479 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.550601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.550717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.550831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.550946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.551059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.551174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.551296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.551602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.551727 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.551843 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.551957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.552061 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.552184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.552300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.552434 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.552628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.552819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.553896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.554214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.554393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.554519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.554643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 13:40:04.554760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.554760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:40:04.554760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 13:40:04.585908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.586114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.586283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.586367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.586442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.586517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.595556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.595798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.625616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.625833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.625977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.626059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.683701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.684674 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.737448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.737689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.738094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.738334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.807733 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.807943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.808121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.808249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.808356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.808438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.808569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.808652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.808783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.808875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.809002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.809222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.832549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.832779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.832887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.832985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.833968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.834127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.846002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.846567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.861912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.862135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.862359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.862453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.862582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.862664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.862799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.862889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.863016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.863098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.863233 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.863317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.863471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.863685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:40:04.881586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.881800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 13:40:04.881967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.882142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.882252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 13:40:04.882332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 13:40:04.882518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.882647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.882752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 13:40:04.882855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.882989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.883111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.883250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.883368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.883506 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.883763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.894879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.895157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.895366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.895518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.895647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.895752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.895918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.896305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.903959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.904717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.907340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.907621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.908027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.908125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.908303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.908402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.908588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.908712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.908849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.909000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.909104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.909308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.909404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.909571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.909661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.909844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.909954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.910113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.910199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.910385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.910659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.910927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.937796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.938368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.939391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.939676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.940012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.940294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.945746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.946026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.946169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.946323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.946493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.946712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.953730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.954014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.954097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.954320 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.958721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.959593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.959743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.959875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.960169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.960263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.960444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.960585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.960716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.960810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.960982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.961072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.961269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.961368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.961539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.961807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.980820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.981009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.981095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.981313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.985666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.985853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.989354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.989501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.989651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.989797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:04.995389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.995527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.999023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:04.999125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.002800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.002914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.003099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.003184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.003384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.003477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.003668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.003751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.003943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.004024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.004219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.004301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.024283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.024659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.024913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.025030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.025185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.025401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.025676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.026019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.033125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.034795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.034896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.035128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.036615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.036950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.038315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.038596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.038888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.039171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.039448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.040251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.040539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.040843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.041127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.041427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.053548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.053823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.054101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.054380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.054659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.054942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.055225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.055656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.055937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.056217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.056499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.056781 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.057059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.057372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.074193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.076258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.077470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.079605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.080811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.082460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.085149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.085279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.085279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.085279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.086309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.086452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.086760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.086939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.092174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.093816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.094483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.096114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.097035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.097351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.097645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.097923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.099424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.099716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.100006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.100357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.107768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.108072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.108352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.109882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.110183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.110499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.117019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.117212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.117526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.117806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.118077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.118353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.118634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.118911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.119081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:40:05.119189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.119364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.119468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.119651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.119735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.119930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.120010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.120202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.120291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.120491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.120597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.120772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.121039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.121344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.121616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.121969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.122176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.122442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.122712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:40:05.160095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d4350169c0 pid: 91848 (default app) May 04 13:40:05.162858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d4350169c0 pid: 91849 (default app) May 04 13:40:05.163902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aabc54-52c3-470f-ad90-24f8a32c7e55 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:05.164200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aabc54-52c3-470f-ad90-24f8a32c7e55 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:05.164482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aabc54-52c3-470f-ad90-24f8a32c7e55 None None] PATH_INFO: `/v3` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:05.168739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Wed May 4 13:40:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:14.806291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11660-6341-4813-9f32-5cca8cd9616a None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:14.806942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11660-6341-4813-9f32-5cca8cd9616a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:14.806942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11660-6341-4813-9f32-5cca8cd9616a None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:14.814194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:40:14.823128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:14.823640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:14.823876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:14.856522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG oslo_db.sqlalchemy.engines [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 13:40:15.049351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG passlib.handlers.bcrypt [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91848) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 13:40:15.049680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG passlib.handlers.bcrypt [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91848) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 13:40:15.109002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:15.110700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:15.251039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 13:40:15.422284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d11660-6341-4813-9f32-5cca8cd9616a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:15.461767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG oslo_db.sqlalchemy.engines [None req-41d11660-6341-4813-9f32-5cca8cd9616a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 13:40:15.594678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d11660-6341-4813-9f32-5cca8cd9616a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:15.599492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13557676-184a-47f4-ad59-422965b8b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:15.602414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557676-184a-47f4-ad59-422965b8b6bf admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:15.602414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557676-184a-47f4-ad59-422965b8b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:15.602414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557676-184a-47f4-ad59-422965b8b6bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:15.610110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13557676-184a-47f4-ad59-422965b8b6bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:15.663229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING keystone.common.rbac_enforcer.enforcer [None req-13557676-184a-47f4-ad59-422965b8b6bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 13:40:15.663565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13557676-184a-47f4-ad59-422965b8b6bf admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:15.674934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1324 bytes} [Wed May 4 13:40:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 13:40:15.681602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:15.696900 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7aa4e-44ee-450b-99d8-c563f72d4605 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:15.702091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48007526-a412-49ab-bc05-cf699c0da1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:15.703241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48007526-a412-49ab-bc05-cf699c0da1bf admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:15.703523 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48007526-a412-49ab-bc05-cf699c0da1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:15.703803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48007526-a412-49ab-bc05-cf699c0da1bf admin admin] PATH_INFO: `/v3/projects/9c3182e031164ef9b9b514b600f7699c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:15.705670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48007526-a412-49ab-bc05-cf699c0da1bf admin admin] RBAC: Authorizing `identity:get_project(project_id=9c3182e031164ef9b9b514b600f7699c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:15.758360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING keystone.common.rbac_enforcer.enforcer [None req-48007526-a412-49ab-bc05-cf699c0da1bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 13:40:15.759135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48007526-a412-49ab-bc05-cf699c0da1bf admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:15.763484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 3/5] 10.222.0.69 () {56 vars in 1207 bytes} [Wed May 4 13:40:15 2022] GET /identity/v3/projects/9c3182e031164ef9b9b514b600f7699c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:18.215052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106a0b0-7c92-444f-bcce-01ddde6b298f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:18.215650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106a0b0-7c92-444f-bcce-01ddde6b298f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:18.215650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106a0b0-7c92-444f-bcce-01ddde6b298f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:18.219789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 3/6] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:18.226272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09eeb3-f955-4f54-b6cf-056719794ed6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:18.226787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09eeb3-f955-4f54-b6cf-056719794ed6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:18.226901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09eeb3-f955-4f54-b6cf-056719794ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:18.249203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-2c09eeb3-f955-4f54-b6cf-056719794ed6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:18.250785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2c09eeb3-f955-4f54-b6cf-056719794ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:18.258926 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 13:40:18.281820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106a0b0-7c92-444f-bcce-01ddde6b298f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:18.294891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106a0b0-7c92-444f-bcce-01ddde6b298f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:18.299084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a6f96-16e2-4e0a-9986-b3d219e009df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:18.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a6f96-16e2-4e0a-9986-b3d219e009df admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:18.299999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a6f96-16e2-4e0a-9986-b3d219e009df admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:18.300274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a6f96-16e2-4e0a-9986-b3d219e009df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:18.309602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a6f96-16e2-4e0a-9986-b3d219e009df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:18.311389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a6f96-16e2-4e0a-9986-b3d219e009df admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:18.320959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1324 bytes} [Wed May 4 13:40:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:40:18.326960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09eeb3-f955-4f54-b6cf-056719794ed6 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:18.337361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09eeb3-f955-4f54-b6cf-056719794ed6 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:18.343677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f2b56-f97b-41a0-b311-a21eb8bfd8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:18.344573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f2b56-f97b-41a0-b311-a21eb8bfd8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:18.344862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f2b56-f97b-41a0-b311-a21eb8bfd8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:18.345145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f2b56-f97b-41a0-b311-a21eb8bfd8a5 admin admin] PATH_INFO: `/v3/users/52cc28158c3e43a08acacdddef40ed48` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:18.346649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f2b56-f97b-41a0-b311-a21eb8bfd8a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=52cc28158c3e43a08acacdddef40ed48)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:18.348521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f2b56-f97b-41a0-b311-a21eb8bfd8a5 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:18.351087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 5/9] 10.222.0.69 () {56 vars in 1198 bytes} [Wed May 4 13:40:18 2022] GET /identity/v3/users/52cc28158c3e43a08acacdddef40ed48 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:20.783169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67e9b-8a1a-4838-97cf-f026aa51f31e None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:20.783682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67e9b-8a1a-4838-97cf-f026aa51f31e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:20.783763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67e9b-8a1a-4838-97cf-f026aa51f31e None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:20.785070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:20.790677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f476f-6724-491e-ba49-5c89d9512de9 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:20.791454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f476f-6724-491e-ba49-5c89d9512de9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:20.791454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f476f-6724-491e-ba49-5c89d9512de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:20.861724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a45e-1c8c-4a3b-915f-96103970e7da None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:20.862010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a45e-1c8c-4a3b-915f-96103970e7da None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:20.862295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2a45e-1c8c-4a3b-915f-96103970e7da None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:20.863701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 6/11] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:40:20.870640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:20.870926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:20.871203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:20.914696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG passlib.handlers.bcrypt [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91849) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 13:40:20.915130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG passlib.handlers.bcrypt [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91849) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 13:40:20.919624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ed2f476f-6724-491e-ba49-5c89d9512de9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:20.920816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ed2f476f-6724-491e-ba49-5c89d9512de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:20.962849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:20.964517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:21.004000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:21.029448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f476f-6724-491e-ba49-5c89d9512de9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:21.076040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:40:21.115630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:21.164429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f476f-6724-491e-ba49-5c89d9512de9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:21.203630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c1c5e-6ebb-4414-adb2-879920ad39dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:21.204435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c1c5e-6ebb-4414-adb2-879920ad39dd None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:21.204759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c1c5e-6ebb-4414-adb2-879920ad39dd None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:21.205042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c1c5e-6ebb-4414-adb2-879920ad39dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:21.217866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c1c5e-6ebb-4414-adb2-879920ad39dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-932c1c5e-6ebb-4414-adb2-879920ad39dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:21.230107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:21.233104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 7/14] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:40:21.238636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c1c5e-6ebb-4414-adb2-879920ad39dd None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:21.240096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e94d7d-baf2-4b0a-81a5-d088e4f295c9 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:21.287355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5f416-fa25-407a-8eb2-a30aacaf48b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:21.288194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f416-fa25-407a-8eb2-a30aacaf48b5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:21.288470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f416-fa25-407a-8eb2-a30aacaf48b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:21.288749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f416-fa25-407a-8eb2-a30aacaf48b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:21.357648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c1c5e-6ebb-4414-adb2-879920ad39dd None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:21.365577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5f416-fa25-407a-8eb2-a30aacaf48b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:21.367130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5f416-fa25-407a-8eb2-a30aacaf48b5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:21.401956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:21.402666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:21.402943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:21.403214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:21.403982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:21.404281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:21.405787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:21.419557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 8/15] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:21.425327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:21.499511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 8/16] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:40:21.508882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5f416-fa25-407a-8eb2-a30aacaf48b5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:21.560756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0151fe-fe3f-41ef-8e97-851a84cd8109 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:21.610760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242131a-f0fd-4228-92fc-085904f74ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:21.611733 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242131a-f0fd-4228-92fc-085904f74ddc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:21.612015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242131a-f0fd-4228-92fc-085904f74ddc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:21.612294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242131a-f0fd-4228-92fc-085904f74ddc None admin] PATH_INFO: `/v3/users/52cc28158c3e43a08acacdddef40ed48` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:21.614060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242131a-f0fd-4228-92fc-085904f74ddc None admin] RBAC: Authorizing `identity:get_user(user_id=52cc28158c3e43a08acacdddef40ed48)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:21.616369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242131a-f0fd-4228-92fc-085904f74ddc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:21.618246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 9/17] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:21 2022] GET /identity/v3/users/52cc28158c3e43a08acacdddef40ed48 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:21.627231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242131a-f0fd-4228-92fc-085904f74ddc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:21.751962 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5f416-fa25-407a-8eb2-a30aacaf48b5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:21.779323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242131a-f0fd-4228-92fc-085904f74ddc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:21.793718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:21.794895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:21.795272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:21.795643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:21.817671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:21.819069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022b49-e99c-4fa0-96d5-45989faf3cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:21.819850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:21.819999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022b49-e99c-4fa0-96d5-45989faf3cb9 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:21.820143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022b49-e99c-4fa0-96d5-45989faf3cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:21.820421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022b49-e99c-4fa0-96d5-45989faf3cb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:21.821818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd022b49-e99c-4fa0-96d5-45989faf3cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:21.823286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd022b49-e99c-4fa0-96d5-45989faf3cb9 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:21.824967 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 10/18] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:21.833001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022b49-e99c-4fa0-96d5-45989faf3cb9 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:40:21.847137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:21.848615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:21.850979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:40:21.850979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:40:21.850979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:40:21.850979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:21.850979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 9/19] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:40:21.858556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:21.953147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022b49-e99c-4fa0-96d5-45989faf3cb9 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:21.988244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2b4d6-7832-42e4-b529-cfa3de059d1b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:21.994379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b4a8a-66a0-4a55-82c7-96e1cb861102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:21.995174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b4a8a-66a0-4a55-82c7-96e1cb861102 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:21.995546 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b4a8a-66a0-4a55-82c7-96e1cb861102 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:21.995902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b4a8a-66a0-4a55-82c7-96e1cb861102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:21.996846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b4a8a-66a0-4a55-82c7-96e1cb861102 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.domain.id=default, user.id=52cc28158c3e43a08acacdddef40ed48) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:21.997264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b4a8a-66a0-4a55-82c7-96e1cb861102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:21.999140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b4a8a-66a0-4a55-82c7-96e1cb861102 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:22.008816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 11/20] 10.222.0.69 () {56 vars in 1322 bytes} [Wed May 4 13:40:21 2022] GET /identity/v3/role_assignments?user.id=52cc28158c3e43a08acacdddef40ed48&scope.domain.id=default&role.id=f1d6bdc882c24a2a9389961135865317 => generated 233 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:22.031375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8671e5-49d4-4499-aa6e-661c4f8640a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:22.032089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8671e5-49d4-4499-aa6e-661c4f8640a9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:22.032380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8671e5-49d4-4499-aa6e-661c4f8640a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:22.032668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8671e5-49d4-4499-aa6e-661c4f8640a9 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:22.033575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8671e5-49d4-4499-aa6e-661c4f8640a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:22.033889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8671e5-49d4-4499-aa6e-661c4f8640a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:22.035383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8671e5-49d4-4499-aa6e-661c4f8640a9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:22.058134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 10/21] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:25.050823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdec8-529b-4bb9-86c3-93923302f9cd None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.051571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdec8-529b-4bb9-86c3-93923302f9cd None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.051687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdec8-529b-4bb9-86c3-93923302f9cd None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.055377 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 12/22] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:25.064347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a9b9-ee74-4370-a2aa-06f62f019544 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.065794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a9b9-ee74-4370-a2aa-06f62f019544 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.066542 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a9b9-ee74-4370-a2aa-06f62f019544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.102889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d480a9b9-ee74-4370-a2aa-06f62f019544 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:25.105836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d480a9b9-ee74-4370-a2aa-06f62f019544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:25.262558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 11/23] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:25.298256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdec8-529b-4bb9-86c3-93923302f9cd None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:25.439998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdec8-529b-4bb9-86c3-93923302f9cd None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:25.476845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfaaed-45fc-4100-bf46-764a0bb86e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:25.477687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfaaed-45fc-4100-bf46-764a0bb86e86 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.478030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfaaed-45fc-4100-bf46-764a0bb86e86 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.478316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfaaed-45fc-4100-bf46-764a0bb86e86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.490634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfaaed-45fc-4100-bf46-764a0bb86e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-aacfaaed-45fc-4100-bf46-764a0bb86e86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:25.498633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:25.499486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:25.500249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 13/24] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:25.510439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480a9b9-ee74-4370-a2aa-06f62f019544 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:25.649446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed310f-97f0-42d4-b6bc-46e4af837b6f None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.650109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed310f-97f0-42d4-b6bc-46e4af837b6f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.650588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed310f-97f0-42d4-b6bc-46e4af837b6f None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.653144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 14/25] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:25.665802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cedb-e860-4919-adef-7588375f2067 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.666434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cedb-e860-4919-adef-7588375f2067 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.666942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4cedb-e860-4919-adef-7588375f2067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.673294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480a9b9-ee74-4370-a2aa-06f62f019544 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:25.696595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e5a4cedb-e860-4919-adef-7588375f2067 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:25.698223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e5a4cedb-e860-4919-adef-7588375f2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:25.716241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:25.716945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.717254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.717545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.718352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:25.718671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:25.720281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:25.743577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 12/26] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:25.763058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:25.793226 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 15/27] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:25.844839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4cedb-e860-4919-adef-7588375f2067 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:25.941202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead43e03-e539-4c7a-886a-03f02f3fa342 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:26.033405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a7fc6-9547-4507-ba65-47324c2d59b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:26.034888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7fc6-9547-4507-ba65-47324c2d59b2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.035413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7fc6-9547-4507-ba65-47324c2d59b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.035948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7fc6-9547-4507-ba65-47324c2d59b2 None admin] PATH_INFO: `/v3/users/52cc28158c3e43a08acacdddef40ed48` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.040981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4cedb-e860-4919-adef-7588375f2067 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:26.045756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a7fc6-9547-4507-ba65-47324c2d59b2 None admin] RBAC: Authorizing `identity:get_user(user_id=52cc28158c3e43a08acacdddef40ed48)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:26.048743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a7fc6-9547-4507-ba65-47324c2d59b2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:26.052663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 13/28] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:25 2022] GET /identity/v3/users/52cc28158c3e43a08acacdddef40ed48 => generated 247 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:26.054625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e269b7-9118-4011-83f2-e550b4e44d6f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.055077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e269b7-9118-4011-83f2-e550b4e44d6f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.055424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e269b7-9118-4011-83f2-e550b4e44d6f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.057788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 14/29] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:26.058945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e269b7-9118-4011-83f2-e550b4e44d6f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:26.159029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662abcf0-8e31-4f58-8537-ce15d03eb82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:26.160155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662abcf0-8e31-4f58-8537-ce15d03eb82f None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.160646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662abcf0-8e31-4f58-8537-ce15d03eb82f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.161154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662abcf0-8e31-4f58-8537-ce15d03eb82f None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.163579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662abcf0-8e31-4f58-8537-ce15d03eb82f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:26.165998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662abcf0-8e31-4f58-8537-ce15d03eb82f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:26.284479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e269b7-9118-4011-83f2-e550b4e44d6f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:26.325108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1080a5-3921-41dc-9329-e4218cb7bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:26.325966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1080a5-3921-41dc-9329-e4218cb7bb22 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.326255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1080a5-3921-41dc-9329-e4218cb7bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.326639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1080a5-3921-41dc-9329-e4218cb7bb22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.327909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1080a5-3921-41dc-9329-e4218cb7bb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:26.329453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1080a5-3921-41dc-9329-e4218cb7bb22 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:26.331484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 15/30] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:26.332972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e329b-539d-4994-b06e-a94fa3f1d79a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.334020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e329b-539d-4994-b06e-a94fa3f1d79a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.334446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e329b-539d-4994-b06e-a94fa3f1d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.353770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-147e329b-539d-4994-b06e-a94fa3f1d79a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:26.355453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-147e329b-539d-4994-b06e-a94fa3f1d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:26.410934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 16/31] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 13:40:25 2022] POST /identity/v3/roles => generated 225 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:26.412971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6729e-deab-4a84-bf01-3021980752ed None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.413455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6729e-deab-4a84-bf01-3021980752ed None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.413874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6729e-deab-4a84-bf01-3021980752ed None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.419745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 17/32] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:26.420922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6729e-deab-4a84-bf01-3021980752ed None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:26.430845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 16/33] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:26.441510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad93394-3d02-49ff-bc97-20e95817511b None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.446179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad93394-3d02-49ff-bc97-20e95817511b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.446933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad93394-3d02-49ff-bc97-20e95817511b None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.449639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 17/34] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:26 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:26.456603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df55e-b1da-4aa2-ba02-cba04f533763 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.456988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df55e-b1da-4aa2-ba02-cba04f533763 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.457207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df55e-b1da-4aa2-ba02-cba04f533763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.495553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a67df55e-b1da-4aa2-ba02-cba04f533763 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:26.499129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a67df55e-b1da-4aa2-ba02-cba04f533763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:26.598439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 18/35] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:26.603265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6729e-deab-4a84-bf01-3021980752ed None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:26.606281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67df55e-b1da-4aa2-ba02-cba04f533763 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:26.646428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8f30-9a6a-4670-87d3-9d7e858bc075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:26.647718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8f30-9a6a-4670-87d3-9d7e858bc075 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.648908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8f30-9a6a-4670-87d3-9d7e858bc075 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.649432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8f30-9a6a-4670-87d3-9d7e858bc075 None admin] PATH_INFO: `/v3/domains/default/users/52cc28158c3e43a08acacdddef40ed48/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.652948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b8f30-9a6a-4670-87d3-9d7e858bc075 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=52cc28158c3e43a08acacdddef40ed48, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:26.655178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b8f30-9a6a-4670-87d3-9d7e858bc075 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:26.729530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 18/36] 10.222.0.69 () {58 vars in 1361 bytes} [Wed May 4 13:40:26 2022] PUT /identity/v3/domains/default/users/52cc28158c3e43a08acacdddef40ed48/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:40:26.731654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a941f8b-8339-4b88-a370-44b83f8f98c3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.731949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a941f8b-8339-4b88-a370-44b83f8f98c3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.732236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a941f8b-8339-4b88-a370-44b83f8f98c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.752585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0a941f8b-8339-4b88-a370-44b83f8f98c3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:26.756707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0a941f8b-8339-4b88-a370-44b83f8f98c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:26.784329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67df55e-b1da-4aa2-ba02-cba04f533763 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:26.839076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e9cff-d311-447b-99fd-5488a93edd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:26.840237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9cff-d311-447b-99fd-5488a93edd25 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.840527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9cff-d311-447b-99fd-5488a93edd25 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.840812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e9cff-d311-447b-99fd-5488a93edd25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.845193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 19/37] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:26.846055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a941f8b-8339-4b88-a370-44b83f8f98c3 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:26.864756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e9cff-d311-447b-99fd-5488a93edd25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:26.868165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e9cff-d311-447b-99fd-5488a93edd25 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-7f7e9cff-d311-447b-99fd-5488a93edd25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:40:26.901871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:26.902923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:26.903832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:40:26.903832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:40:26.903832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:40:26.903832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:26.904087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 19/38] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:26.909651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a39b-e4cd-4450-9479-a0f60c41354f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:26.909651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a39b-e4cd-4450-9479-a0f60c41354f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:26.909651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a39b-e4cd-4450-9479-a0f60c41354f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:26.910628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 20/39] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:26.911947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a39b-e4cd-4450-9479-a0f60c41354f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:27.008903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a941f8b-8339-4b88-a370-44b83f8f98c3 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:27.062845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01c0d-42f9-4f6f-82df-effc50fac04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:27.063528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01c0d-42f9-4f6f-82df-effc50fac04e None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:27.063812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01c0d-42f9-4f6f-82df-effc50fac04e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:27.064094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01c0d-42f9-4f6f-82df-effc50fac04e None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:27.065363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c01c0d-42f9-4f6f-82df-effc50fac04e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:27.066351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c01c0d-42f9-4f6f-82df-effc50fac04e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:27.080447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a39b-e4cd-4450-9479-a0f60c41354f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:27.123923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432df31-1812-4dcb-bf0c-257636e586b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:27.124562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432df31-1812-4dcb-bf0c-257636e586b6 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:27.124861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432df31-1812-4dcb-bf0c-257636e586b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:27.125141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432df31-1812-4dcb-bf0c-257636e586b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:27.125945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432df31-1812-4dcb-bf0c-257636e586b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:27.127348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432df31-1812-4dcb-bf0c-257636e586b6 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:27.158421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 20/40] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 13:40:26 2022] POST /identity/v3/roles => generated 219 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:27.159101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01c0d-42f9-4f6f-82df-effc50fac04e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:27.285772 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01c0d-42f9-4f6f-82df-effc50fac04e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:27.328050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b683d-cd6f-4876-804b-358ed6951b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:27.328981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b683d-cd6f-4876-804b-358ed6951b96 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:27.329431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b683d-cd6f-4876-804b-358ed6951b96 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:27.329854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b683d-cd6f-4876-804b-358ed6951b96 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:27.330792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b683d-cd6f-4876-804b-358ed6951b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:27.331254 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b683d-cd6f-4876-804b-358ed6951b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:27.332883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b683d-cd6f-4876-804b-358ed6951b96 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:27.359417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 21/41] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:27.361462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761c3f-da7d-4191-b492-0c8dc48dd1c6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:27.361925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761c3f-da7d-4191-b492-0c8dc48dd1c6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:27.362345 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761c3f-da7d-4191-b492-0c8dc48dd1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:27.381310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6b761c3f-da7d-4191-b492-0c8dc48dd1c6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:27.382734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6b761c3f-da7d-4191-b492-0c8dc48dd1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:27.407733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 21/42] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 13:40:26 2022] POST /identity/v3/roles => generated 223 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:27.409388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432df31-1812-4dcb-bf0c-257636e586b6 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:27.476379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 22/43] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:27.502495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b761c3f-da7d-4191-b492-0c8dc48dd1c6 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:27.531088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432df31-1812-4dcb-bf0c-257636e586b6 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:27.572497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de075f-0e6f-4317-9764-8472c63d5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:27.573594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de075f-0e6f-4317-9764-8472c63d5689 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:27.574096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de075f-0e6f-4317-9764-8472c63d5689 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:27.574548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de075f-0e6f-4317-9764-8472c63d5689 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:27.575457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de075f-0e6f-4317-9764-8472c63d5689 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:27.577317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de075f-0e6f-4317-9764-8472c63d5689 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:27.631536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b761c3f-da7d-4191-b492-0c8dc48dd1c6 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:27.677487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ff6e-9e69-428a-9b7f-5852a7c0f9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:27.678488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ff6e-9e69-428a-9b7f-5852a7c0f9f0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:27.678831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ff6e-9e69-428a-9b7f-5852a7c0f9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:27.679116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ff6e-9e69-428a-9b7f-5852a7c0f9f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:27.680468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489ff6e-9e69-428a-9b7f-5852a7c0f9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:27.682063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489ff6e-9e69-428a-9b7f-5852a7c0f9f0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:27.683822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 23/44] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:27.690354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ff6e-9e69-428a-9b7f-5852a7c0f9f0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:27.693471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:40:27 2022] POST /identity/v3/projects => generated 301 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:27.835402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ff6e-9e69-428a-9b7f-5852a7c0f9f0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:27.877232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf358ef-ad8a-43ce-92eb-1ee4971b4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:27.877946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf358ef-ad8a-43ce-92eb-1ee4971b4ea0 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:27.878236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf358ef-ad8a-43ce-92eb-1ee4971b4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:27.878518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf358ef-ad8a-43ce-92eb-1ee4971b4ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:27.879259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf358ef-ad8a-43ce-92eb-1ee4971b4ea0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:27.881395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf358ef-ad8a-43ce-92eb-1ee4971b4ea0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:28.204296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:40:27 2022] POST /identity/v3/projects => generated 312 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:40:29.229321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23ec7-e627-4a82-99a6-5dcf7527dcf1 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:29.230048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23ec7-e627-4a82-99a6-5dcf7527dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:29.230304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c23ec7-e627-4a82-99a6-5dcf7527dcf1 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:29.232744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 23/47] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:29.239961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426883-59d7-40ea-96d1-3ae457835a3f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:29.241546 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426883-59d7-40ea-96d1-3ae457835a3f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:29.241546 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426883-59d7-40ea-96d1-3ae457835a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:29.264405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d3426883-59d7-40ea-96d1-3ae457835a3f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:29.266352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d3426883-59d7-40ea-96d1-3ae457835a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:29.343424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 25/48] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:40:29.368556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c23ec7-e627-4a82-99a6-5dcf7527dcf1 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:29.480413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c23ec7-e627-4a82-99a6-5dcf7527dcf1 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:29.521572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a75e-a9c6-49de-a8e1-ecbc32ee7bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:29.522395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a75e-a9c6-49de-a8e1-ecbc32ee7bbc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:29.522675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a75e-a9c6-49de-a8e1-ecbc32ee7bbc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:29.523022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a75e-a9c6-49de-a8e1-ecbc32ee7bbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:29.534995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4a75e-a9c6-49de-a8e1-ecbc32ee7bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-8fa4a75e-a9c6-49de-a8e1-ecbc32ee7bbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:29.544797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:29.546152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:29.547376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 24/49] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:40:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:29.552043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3426883-59d7-40ea-96d1-3ae457835a3f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:29.681254 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3426883-59d7-40ea-96d1-3ae457835a3f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:29.720106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:29.720781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:29.721104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:29.721368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:29.722137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:29.722447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:29.723861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:29.738997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 26/50] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:29.741091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a75e-a9c6-49de-a8e1-ecbc32ee7bbc None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:29.852479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a75e-a9c6-49de-a8e1-ecbc32ee7bbc None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:29.894246 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604aeb-79d5-47bd-886b-1fee88d44f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:29.895603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604aeb-79d5-47bd-886b-1fee88d44f85 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:29.896663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604aeb-79d5-47bd-886b-1fee88d44f85 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:29.897169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604aeb-79d5-47bd-886b-1fee88d44f85 None admin] PATH_INFO: `/v3/users/52cc28158c3e43a08acacdddef40ed48` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:29.899458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f604aeb-79d5-47bd-886b-1fee88d44f85 None admin] RBAC: Authorizing `identity:get_user(user_id=52cc28158c3e43a08acacdddef40ed48)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:29.902267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f604aeb-79d5-47bd-886b-1fee88d44f85 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:29.905152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 25/51] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:29 2022] GET /identity/v3/users/52cc28158c3e43a08acacdddef40ed48 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:29.913038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:30.032086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddc870-d53c-434f-81d0-845fb1bf0ef9 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:30.071205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34aeaa-0189-4362-a2ea-a9c867a44c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:30.072012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34aeaa-0189-4362-a2ea-a9c867a44c62 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:30.072295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34aeaa-0189-4362-a2ea-a9c867a44c62 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:30.072596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34aeaa-0189-4362-a2ea-a9c867a44c62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:30.073936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34aeaa-0189-4362-a2ea-a9c867a44c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:30.075396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34aeaa-0189-4362-a2ea-a9c867a44c62 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:30.077050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 27/52] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:30.083578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604aeb-79d5-47bd-886b-1fee88d44f85 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:30.209181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604aeb-79d5-47bd-886b-1fee88d44f85 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:30.247228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadb4e3-5005-414a-9aee-56342e82ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:30.248350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadb4e3-5005-414a-9aee-56342e82ef5f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:30.248832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadb4e3-5005-414a-9aee-56342e82ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:30.249356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadb4e3-5005-414a-9aee-56342e82ef5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:30.250907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadb4e3-5005-414a-9aee-56342e82ef5f None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.domain.id=default, user.id=52cc28158c3e43a08acacdddef40ed48) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:30.251467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadb4e3-5005-414a-9aee-56342e82ef5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:30.254108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadb4e3-5005-414a-9aee-56342e82ef5f None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:30.269717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1322 bytes} [Wed May 4 13:40:30 2022] GET /identity/v3/role_assignments?user.id=52cc28158c3e43a08acacdddef40ed48&scope.domain.id=default&role.id=f1d6bdc882c24a2a9389961135865317 => generated 530 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:30.574555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124192f-8bd1-41e4-bc3d-3b01ec2594b2 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:30.575110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124192f-8bd1-41e4-bc3d-3b01ec2594b2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:30.575110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124192f-8bd1-41e4-bc3d-3b01ec2594b2 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:30.576496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 28/54] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:30.581920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26c053-98ec-4384-b9dc-ebeb6258470e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:30.582217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26c053-98ec-4384-b9dc-ebeb6258470e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:30.582504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26c053-98ec-4384-b9dc-ebeb6258470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:30.601516 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-cb26c053-98ec-4384-b9dc-ebeb6258470e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:30.605549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-cb26c053-98ec-4384-b9dc-ebeb6258470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:30.675268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 27/55] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:40:30.699960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124192f-8bd1-41e4-bc3d-3b01ec2594b2 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:30.808278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124192f-8bd1-41e4-bc3d-3b01ec2594b2 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:30.847913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f4c78-5832-4a40-b248-84a3ed8f9e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:30.849393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f4c78-5832-4a40-b248-84a3ed8f9e29 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:30.849791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f4c78-5832-4a40-b248-84a3ed8f9e29 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:30.850076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f4c78-5832-4a40-b248-84a3ed8f9e29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:30.851862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f4c78-5832-4a40-b248-84a3ed8f9e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:30.854418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f4c78-5832-4a40-b248-84a3ed8f9e29 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:30.856812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 29/56] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:30.863280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26c053-98ec-4384-b9dc-ebeb6258470e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:30.977357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26c053-98ec-4384-b9dc-ebeb6258470e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:31.012928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946450a-14c9-4cf4-b8aa-f7ba1c8830dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:31.013664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946450a-14c9-4cf4-b8aa-f7ba1c8830dd None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:31.013987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946450a-14c9-4cf4-b8aa-f7ba1c8830dd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:31.014263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946450a-14c9-4cf4-b8aa-f7ba1c8830dd None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:31.014991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946450a-14c9-4cf4-b8aa-f7ba1c8830dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:31.016522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946450a-14c9-4cf4-b8aa-f7ba1c8830dd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:31.357968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 28/57] 10.222.0.69 () {60 vars in 1140 bytes} [Wed May 4 13:40:30 2022] POST /identity/v3/projects => generated 298 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:33.649975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b704-ec74-488e-80b2-0067a854d3b0 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:33.650532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b704-ec74-488e-80b2-0067a854d3b0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:33.650624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b704-ec74-488e-80b2-0067a854d3b0 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:33.651953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 30/58] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:33.657679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539aae-5d13-4b7c-b94d-b84179cc5995 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:33.658386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539aae-5d13-4b7c-b94d-b84179cc5995 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:33.658386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539aae-5d13-4b7c-b94d-b84179cc5995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:33.683148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b9539aae-5d13-4b7c-b94d-b84179cc5995 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:33.685136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b9539aae-5d13-4b7c-b94d-b84179cc5995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:33.752831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 29/59] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:33.778878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b704-ec74-488e-80b2-0067a854d3b0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:33.879629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b704-ec74-488e-80b2-0067a854d3b0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:33.914393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a8bf7-2583-41c9-8638-eb5fcf5d3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:33.915103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a8bf7-2583-41c9-8638-eb5fcf5d3843 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:33.915388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a8bf7-2583-41c9-8638-eb5fcf5d3843 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:33.915666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a8bf7-2583-41c9-8638-eb5fcf5d3843 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:33.916908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a8bf7-2583-41c9-8638-eb5fcf5d3843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:33.918393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a8bf7-2583-41c9-8638-eb5fcf5d3843 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:33.919998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 31/60] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:33.925580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539aae-5d13-4b7c-b94d-b84179cc5995 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:34.024185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539aae-5d13-4b7c-b94d-b84179cc5995 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:34.055512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28127f4-a708-47a1-99ea-87d595988101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:34.056184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28127f4-a708-47a1-99ea-87d595988101 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:34.056469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28127f4-a708-47a1-99ea-87d595988101 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:34.056748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28127f4-a708-47a1-99ea-87d595988101 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:34.057502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28127f4-a708-47a1-99ea-87d595988101 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:34.058981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28127f4-a708-47a1-99ea-87d595988101 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:34.164792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 30/61] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:40:33 2022] POST /identity/v3/users => generated 275 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:40:38.015144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e912c-af4e-46a8-b923-654aba018ddf None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.015990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e912c-af4e-46a8-b923-654aba018ddf None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.016421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e912c-af4e-46a8-b923-654aba018ddf None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.018593 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 32/62] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:38.026336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5476fa9-e97b-4226-b397-03fbaa94ee11 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.027223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5476fa9-e97b-4226-b397-03fbaa94ee11 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.027649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5476fa9-e97b-4226-b397-03fbaa94ee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.057865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a5476fa9-e97b-4226-b397-03fbaa94ee11 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:38.059320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a5476fa9-e97b-4226-b397-03fbaa94ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:38.199839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 31/63] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:38.234636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e75c4-850c-440a-82a0-619564c60e2d None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.235265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e75c4-850c-440a-82a0-619564c60e2d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.235784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e75c4-850c-440a-82a0-619564c60e2d None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.239059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 33/64] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:40:38.246114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b687ba-ea8f-4a0d-aa1c-8cab98697eb4 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.246710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b687ba-ea8f-4a0d-aa1c-8cab98697eb4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.247193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b687ba-ea8f-4a0d-aa1c-8cab98697eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.257975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e75c4-850c-440a-82a0-619564c60e2d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:38.310911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d9b687ba-ea8f-4a0d-aa1c-8cab98697eb4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:38.315539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d9b687ba-ea8f-4a0d-aa1c-8cab98697eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:38.453845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e75c4-850c-440a-82a0-619564c60e2d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:38.537427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750ad32-ea53-4be2-9f29-19546bf074ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:38.538263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 32/65] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:40:38.538696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ad32-ea53-4be2-9f29-19546bf074ae None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.539251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ad32-ea53-4be2-9f29-19546bf074ae None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.539803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ad32-ea53-4be2-9f29-19546bf074ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.540896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8673c2-a6a0-422a-aade-c6c24ed82ade None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.541443 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8673c2-a6a0-422a-aade-c6c24ed82ade None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.541929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8673c2-a6a0-422a-aade-c6c24ed82ade None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.543984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 33/66] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:38.551223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a8376-709d-48f4-843a-95811b34702e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.552254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a8376-709d-48f4-843a-95811b34702e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.552745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a8376-709d-48f4-843a-95811b34702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.560301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750ad32-ea53-4be2-9f29-19546bf074ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-a750ad32-ea53-4be2-9f29-19546bf074ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:38.581715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:38.584183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:38.585751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:38.586911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d61a8376-709d-48f4-843a-95811b34702e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:38.590315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 34/67] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:40:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:40:38.591170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d61a8376-709d-48f4-843a-95811b34702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:38.603761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750ad32-ea53-4be2-9f29-19546bf074ae None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:38.710615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 34/68] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:38.711774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a8376-709d-48f4-843a-95811b34702e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:38.793946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750ad32-ea53-4be2-9f29-19546bf074ae None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:38.829456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d552-2fd8-432e-b303-42c092e46a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:38.829970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d552-2fd8-432e-b303-42c092e46a90 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.830251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d552-2fd8-432e-b303-42c092e46a90 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.830528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d552-2fd8-432e-b303-42c092e46a90 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.831286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760d552-2fd8-432e-b303-42c092e46a90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:38.831592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760d552-2fd8-432e-b303-42c092e46a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:38.833122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760d552-2fd8-432e-b303-42c092e46a90 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:38.841763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 35/69] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:38.843185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd83-d1a3-4a14-9f87-f314f459934d None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.843477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd83-d1a3-4a14-9f87-f314f459934d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.843757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bfd83-d1a3-4a14-9f87-f314f459934d None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.845003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 36/70] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:38.845714 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bfd83-d1a3-4a14-9f87-f314f459934d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:38.856139 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a8376-709d-48f4-843a-95811b34702e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:38.891768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8a202-b8cb-4dfc-be5b-24c3f7e0de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:38.892572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8a202-b8cb-4dfc-be5b-24c3f7e0de65 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.892852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8a202-b8cb-4dfc-be5b-24c3f7e0de65 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.893136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8a202-b8cb-4dfc-be5b-24c3f7e0de65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.908657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8a202-b8cb-4dfc-be5b-24c3f7e0de65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-daa8a202-b8cb-4dfc-be5b-24c3f7e0de65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:38.916585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:38.917764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:38.918551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:38.919679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d796-357c-4c77-b23a-5c37f7920cba None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:38.919934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d796-357c-4c77-b23a-5c37f7920cba None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:38.920220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d796-357c-4c77-b23a-5c37f7920cba None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:38.921563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 36/72] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:38.922277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656d796-357c-4c77-b23a-5c37f7920cba None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:38.960635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bfd83-d1a3-4a14-9f87-f314f459934d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.001119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c674d-c45d-4c53-b027-600b6097475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.002170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c674d-c45d-4c53-b027-600b6097475f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.002459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c674d-c45d-4c53-b027-600b6097475f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.002850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c674d-c45d-4c53-b027-600b6097475f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.022171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c674d-c45d-4c53-b027-600b6097475f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-c68c674d-c45d-4c53-b027-600b6097475f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:39.030643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:39.031588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:39.032323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 37/73] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:40:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:39.033649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745365c-8a4b-4615-8c37-c25b751f81d4 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.033940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745365c-8a4b-4615-8c37-c25b751f81d4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.034281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745365c-8a4b-4615-8c37-c25b751f81d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.038939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656d796-357c-4c77-b23a-5c37f7920cba None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.052567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a745365c-8a4b-4615-8c37-c25b751f81d4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:39.054141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a745365c-8a4b-4615-8c37-c25b751f81d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:39.090703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6bbe8-041b-4de8-8f7a-92791485f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.091607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6bbe8-041b-4de8-8f7a-92791485f06b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.091889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6bbe8-041b-4de8-8f7a-92791485f06b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.092204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6bbe8-041b-4de8-8f7a-92791485f06b None admin] PATH_INFO: `/v3/users/52cc28158c3e43a08acacdddef40ed48` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.093540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6bbe8-041b-4de8-8f7a-92791485f06b None admin] RBAC: Authorizing `identity:get_user(user_id=52cc28158c3e43a08acacdddef40ed48)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:39.095045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6bbe8-041b-4de8-8f7a-92791485f06b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:39.096770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 37/74] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:38 2022] GET /identity/v3/users/52cc28158c3e43a08acacdddef40ed48 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:39.097630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6bbe8-041b-4de8-8f7a-92791485f06b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:39.149441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 38/75] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:39.149441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e9d9-a4a0-4a92-957c-f2387d6be7ef None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.149441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e9d9-a4a0-4a92-957c-f2387d6be7ef None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.149441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e9d9-a4a0-4a92-957c-f2387d6be7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.168749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-aa06e9d9-a4a0-4a92-957c-f2387d6be7ef None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:39.170090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-aa06e9d9-a4a0-4a92-957c-f2387d6be7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:39.242928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6bbe8-041b-4de8-8f7a-92791485f06b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.244286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 39/76] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:39.245148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e9d9-a4a0-4a92-957c-f2387d6be7ef None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:39.289223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.290198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.290486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.290769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.291538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] RBAC: Adding query filter params (name=member) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:39.291847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:39.293289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:39.302842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 38/77] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:39.303829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:39.363697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e9d9-a4a0-4a92-957c-f2387d6be7ef None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.411857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.412577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.412867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.413101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae34a-ac01-4671-a417-70a027940707 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.413206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.413941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:39.414255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:39.415726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:39.425062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 40/78] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:40:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:39.425977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:39.450432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de2d75-9ba8-49b1-9a0f-004e977d8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.451104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2d75-9ba8-49b1-9a0f-004e977d8221 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.451394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2d75-9ba8-49b1-9a0f-004e977d8221 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.451703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2d75-9ba8-49b1-9a0f-004e977d8221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.522691 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de2d75-9ba8-49b1-9a0f-004e977d8221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:39.524199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de2d75-9ba8-49b1-9a0f-004e977d8221 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:39.543832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b67e8-85ec-4328-92b0-dc49910e973a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.579737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ae41-fc6b-4d20-832e-e853035790b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.580537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ae41-fc6b-4d20-832e-e853035790b2 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.580831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ae41-fc6b-4d20-832e-e853035790b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.581114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ae41-fc6b-4d20-832e-e853035790b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.582428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975ae41-fc6b-4d20-832e-e853035790b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:39.584896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975ae41-fc6b-4d20-832e-e853035790b2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:39.586646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 41/79] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:39.587469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ae41-fc6b-4d20-832e-e853035790b2 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:39.643385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 39/80] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:39.645785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de2d75-9ba8-49b1-9a0f-004e977d8221 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:39.707342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ae41-fc6b-4d20-832e-e853035790b2 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.759077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1da00-be72-499c-8b44-4c7d3228cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.760023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1da00-be72-499c-8b44-4c7d3228cf74 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.760504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1da00-be72-499c-8b44-4c7d3228cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.761004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1da00-be72-499c-8b44-4c7d3228cf74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.776763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de2d75-9ba8-49b1-9a0f-004e977d8221 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.781691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1da00-be72-499c-8b44-4c7d3228cf74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-88d1da00-be72-499c-8b44-4c7d3228cf74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:39.796447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:39.797524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:39.798265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:39.798834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 42/81] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:39.800166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1da00-be72-499c-8b44-4c7d3228cf74 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:39.826198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eefbd-4219-4e3f-8f86-03352d90323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.827697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eefbd-4219-4e3f-8f86-03352d90323e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.828170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eefbd-4219-4e3f-8f86-03352d90323e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.828656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eefbd-4219-4e3f-8f86-03352d90323e None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.857357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eefbd-4219-4e3f-8f86-03352d90323e None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:39.859683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eefbd-4219-4e3f-8f86-03352d90323e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:39.862912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 40/82] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:39 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:39.864591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eefbd-4219-4e3f-8f86-03352d90323e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:39.915111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1da00-be72-499c-8b44-4c7d3228cf74 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:39.951612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746ab8-d3c2-4e5e-8cb3-63c2c7146d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:39.952510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746ab8-d3c2-4e5e-8cb3-63c2c7146d55 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:39.952804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746ab8-d3c2-4e5e-8cb3-63c2c7146d55 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:39.953088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746ab8-d3c2-4e5e-8cb3-63c2c7146d55 None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:39.954452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2746ab8-d3c2-4e5e-8cb3-63c2c7146d55 None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:39.955947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2746ab8-d3c2-4e5e-8cb3-63c2c7146d55 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:39.957759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 43/83] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:39 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:39.958696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746ab8-d3c2-4e5e-8cb3-63c2c7146d55 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:40.015385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eefbd-4219-4e3f-8f86-03352d90323e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:40.086009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c859f4-1855-4b04-b9c8-0b858fc561ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:40.087169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c859f4-1855-4b04-b9c8-0b858fc561ee None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.087664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c859f4-1855-4b04-b9c8-0b858fc561ee None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.088266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c859f4-1855-4b04-b9c8-0b858fc561ee None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.089461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746ab8-d3c2-4e5e-8cb3-63c2c7146d55 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:40.089943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c859f4-1855-4b04-b9c8-0b858fc561ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:40.092161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c859f4-1855-4b04-b9c8-0b858fc561ee None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:40.128264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af359c7-0e07-41d0-8417-03d2fe232c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:40.138700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af359c7-0e07-41d0-8417-03d2fe232c3b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.138700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af359c7-0e07-41d0-8417-03d2fe232c3b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.138700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af359c7-0e07-41d0-8417-03d2fe232c3b None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.138700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af359c7-0e07-41d0-8417-03d2fe232c3b None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:40.138700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af359c7-0e07-41d0-8417-03d2fe232c3b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:40.138700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 44/84] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:39 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:40.139187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af359c7-0e07-41d0-8417-03d2fe232c3b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:40.245878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af359c7-0e07-41d0-8417-03d2fe232c3b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:40.249316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 41/85] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:40:39 2022] POST /identity/v3/users => generated 289 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:40.250250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c859f4-1855-4b04-b9c8-0b858fc561ee None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:40.297486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:40.304675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.304675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.304675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.304675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:40.304675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:40.304675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:40.319796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 45/86] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:40.321650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:40.376719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c859f4-1855-4b04-b9c8-0b858fc561ee None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:40.435128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8def-8143-4e21-88b7-071f69c6b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:40.436281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8def-8143-4e21-88b7-071f69c6b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.436777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8def-8143-4e21-88b7-071f69c6b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.437295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8def-8143-4e21-88b7-071f69c6b1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.478559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673340-0546-4d2b-a1cc-514e4e29a414 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:40.536103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbfcc4-de59-4312-a28c-43a0bd5d2997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:40.536841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbfcc4-de59-4312-a28c-43a0bd5d2997 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.537123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbfcc4-de59-4312-a28c-43a0bd5d2997 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.537455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbfcc4-de59-4312-a28c-43a0bd5d2997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.551120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf8def-8143-4e21-88b7-071f69c6b1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:40.555092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf8def-8143-4e21-88b7-071f69c6b1f9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:40.624267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbfcc4-de59-4312-a28c-43a0bd5d2997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:40.625892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbfcc4-de59-4312-a28c-43a0bd5d2997 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:40.718456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 42/87] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:40.720310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8def-8143-4e21-88b7-071f69c6b1f9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:40.771451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 46/88] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:40.772834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbfcc4-de59-4312-a28c-43a0bd5d2997 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:40.885920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbfcc4-de59-4312-a28c-43a0bd5d2997 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:40.898453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8def-8143-4e21-88b7-071f69c6b1f9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:40.926168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bec755-8ce2-4e30-ac01-241a3dbb7a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:40.927530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bec755-8ce2-4e30-ac01-241a3dbb7a46 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.928025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bec755-8ce2-4e30-ac01-241a3dbb7a46 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.928520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bec755-8ce2-4e30-ac01-241a3dbb7a46 None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.930164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bec755-8ce2-4e30-ac01-241a3dbb7a46 None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:40.932023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bec755-8ce2-4e30-ac01-241a3dbb7a46 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:40.934068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 47/89] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:40 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:40.935139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bec755-8ce2-4e30-ac01-241a3dbb7a46 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:40.954499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:40.955587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.956105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.956543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.958278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=a115aa26e75244d4a57940a1d2497960, user.id=52cc28158c3e43a08acacdddef40ed48) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:40.958863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:40.961778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:40.970415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 43/90] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:40 2022] GET /identity/v3/role_assignments?user.id=52cc28158c3e43a08acacdddef40ed48&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=f1d6bdc882c24a2a9389961135865317 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:40.971313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:41.056731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bec755-8ce2-4e30-ac01-241a3dbb7a46 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:41.105606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1288-e813-444d-a86b-042a26e4ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:41.107428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1288-e813-444d-a86b-042a26e4ae63 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:41.107971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1288-e813-444d-a86b-042a26e4ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:41.108456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1288-e813-444d-a86b-042a26e4ae63 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:41.110143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c1288-e813-444d-a86b-042a26e4ae63 None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:41.112506 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c1288-e813-444d-a86b-042a26e4ae63 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:41.116206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 48/91] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:40 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:41.117539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1288-e813-444d-a86b-042a26e4ae63 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:41.214843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b818d-034a-42d6-bda9-e012716334ad None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:41.242183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1288-e813-444d-a86b-042a26e4ae63 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:41.280377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ccd75-4625-4dcf-836f-7e1e0e99596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:41.281438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9391b4-5c7d-46ee-a607-5039aa25ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:41.281924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccd75-4625-4dcf-836f-7e1e0e99596b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:41.282415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccd75-4625-4dcf-836f-7e1e0e99596b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:41.282850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9391b4-5c7d-46ee-a607-5039aa25ff8e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:41.282954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ccd75-4625-4dcf-836f-7e1e0e99596b None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:41.283504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9391b4-5c7d-46ee-a607-5039aa25ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:41.283992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9391b4-5c7d-46ee-a607-5039aa25ff8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:41.285042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ccd75-4625-4dcf-836f-7e1e0e99596b None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:41.287802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ccd75-4625-4dcf-836f-7e1e0e99596b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:41.291602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 44/92] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:40 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:41.293067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ccd75-4625-4dcf-836f-7e1e0e99596b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:41.410452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9391b4-5c7d-46ee-a607-5039aa25ff8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:41.412930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9391b4-5c7d-46ee-a607-5039aa25ff8e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:41.458161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ccd75-4625-4dcf-836f-7e1e0e99596b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:41.501163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:41.501792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:41.502087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:41.502371 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:41.503239 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] RBAC: Adding query filter params (role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=a115aa26e75244d4a57940a1d2497960, user.id=84dac3517ebe4f76ae9dfbd924114efe) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:41.503557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:41.505194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:41.513065 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 45/93] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:41 2022] GET /identity/v3/role_assignments?user.id=84dac3517ebe4f76ae9dfbd924114efe&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=68f91fa718f44020a307be6b2f10b834 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:41.514041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:41.691118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 49/94] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:41.699720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9391b4-5c7d-46ee-a607-5039aa25ff8e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:41.768745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ebf4b-d959-4009-be40-f40edce85138 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:41.837253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:41.837952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:41.838241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:41.838523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:41.839405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] RBAC: Adding query filter params (role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=a115aa26e75244d4a57940a1d2497960, user.id=84dac3517ebe4f76ae9dfbd924114efe) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:41.839720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:41.841344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:41.847658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 46/95] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:41 2022] GET /identity/v3/role_assignments?user.id=84dac3517ebe4f76ae9dfbd924114efe&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:41.953276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9391b4-5c7d-46ee-a607-5039aa25ff8e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:42.013139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7b719-1120-48ee-9c8e-ba96e9d3e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:42.014001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7b719-1120-48ee-9c8e-ba96e9d3e832 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:42.014339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7b719-1120-48ee-9c8e-ba96e9d3e832 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:42.014626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7b719-1120-48ee-9c8e-ba96e9d3e832 None admin] PATH_INFO: `/v3/projects/df73c25db1f74cdca0e22fe67f82a359` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:42.016094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7b719-1120-48ee-9c8e-ba96e9d3e832 None admin] RBAC: Authorizing `identity:get_project(project_id=df73c25db1f74cdca0e22fe67f82a359)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:42.017703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7b719-1120-48ee-9c8e-ba96e9d3e832 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:42.019681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 50/96] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:41 2022] GET /identity/v3/projects/df73c25db1f74cdca0e22fe67f82a359 => generated 312 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:42.026848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:42.198361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb32f0-4169-4d47-b2bd-b1ee8fb1a6c0 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:42.244882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811701-558c-4c0c-bd55-62e7d8bc2883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:42.246542 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811701-558c-4c0c-bd55-62e7d8bc2883 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:42.247219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811701-558c-4c0c-bd55-62e7d8bc2883 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:42.247956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811701-558c-4c0c-bd55-62e7d8bc2883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:42.249363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811701-558c-4c0c-bd55-62e7d8bc2883 None admin] RBAC: Adding query filter params (role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=df73c25db1f74cdca0e22fe67f82a359, user.id=84dac3517ebe4f76ae9dfbd924114efe) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:42.250154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811701-558c-4c0c-bd55-62e7d8bc2883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:42.252041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811701-558c-4c0c-bd55-62e7d8bc2883 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:42.259970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 47/97] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:42 2022] GET /identity/v3/role_assignments?user.id=84dac3517ebe4f76ae9dfbd924114efe&scope.project.id=df73c25db1f74cdca0e22fe67f82a359&role.id=68f91fa718f44020a307be6b2f10b834 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:43.574459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b42c4-4138-46a9-b545-809ba1afbe2b None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:43.575037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b42c4-4138-46a9-b545-809ba1afbe2b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:43.575114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b42c4-4138-46a9-b545-809ba1afbe2b None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:43.576481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 51/98] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:43.594938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b2f3-1c01-41f7-ac7d-711eafb4dfe5 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:43.595895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b2f3-1c01-41f7-ac7d-711eafb4dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:43.602021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b2f3-1c01-41f7-ac7d-711eafb4dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:43.619550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1a03b2f3-1c01-41f7-ac7d-711eafb4dfe5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:43.620777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1a03b2f3-1c01-41f7-ac7d-711eafb4dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:43.743113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 48/99] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:43.789524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b42c4-4138-46a9-b545-809ba1afbe2b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:43.926107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b42c4-4138-46a9-b545-809ba1afbe2b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:43.975619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bb92-a45b-42df-9b32-4f3410c76ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:43.976451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bb92-a45b-42df-9b32-4f3410c76ef2 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:43.976738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bb92-a45b-42df-9b32-4f3410c76ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:43.977020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bb92-a45b-42df-9b32-4f3410c76ef2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:43.982160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13bb92-a45b-42df-9b32-4f3410c76ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:43.983676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13bb92-a45b-42df-9b32-4f3410c76ef2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:43.985456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 52/100] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:43.991666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b2f3-1c01-41f7-ac7d-711eafb4dfe5 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:44.125273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b2f3-1c01-41f7-ac7d-711eafb4dfe5 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:44.171335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eb38b-41be-4db8-99a3-e0e3db555658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:44.172034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eb38b-41be-4db8-99a3-e0e3db555658 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:44.172324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eb38b-41be-4db8-99a3-e0e3db555658 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:44.172608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eb38b-41be-4db8-99a3-e0e3db555658 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:44.174566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b34a1-976e-420e-8ee9-aea4c90c1561 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:44.174851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b34a1-976e-420e-8ee9-aea4c90c1561 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:44.175187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b34a1-976e-420e-8ee9-aea4c90c1561 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:44.177474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 53/101] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:40:44.178002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eb38b-41be-4db8-99a3-e0e3db555658 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:44.179668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eb38b-41be-4db8-99a3-e0e3db555658 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:44.186821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951ce8-01cd-458d-b261-1b393e1d2693 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:44.187106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951ce8-01cd-458d-b261-1b393e1d2693 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:44.187395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0951ce8-01cd-458d-b261-1b393e1d2693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:44.219246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b0951ce8-01cd-458d-b261-1b393e1d2693 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:44.220834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b0951ce8-01cd-458d-b261-1b393e1d2693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:44.302410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 49/102] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:40:43 2022] POST /identity/v3/projects => generated 302 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:44.342885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 54/103] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:44.383219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eb38b-41be-4db8-99a3-e0e3db555658 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:44.509304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eb38b-41be-4db8-99a3-e0e3db555658 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:44.514289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700bba8-76a8-4107-a375-70dcdaa90d43 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:44.514588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700bba8-76a8-4107-a375-70dcdaa90d43 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:44.514864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700bba8-76a8-4107-a375-70dcdaa90d43 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:44.517352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 55/104] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:44.523225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229e27-aa14-4109-897b-220d04d899fb None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:44.523521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229e27-aa14-4109-897b-220d04d899fb None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:44.523803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229e27-aa14-4109-897b-220d04d899fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:44.543011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-7c229e27-aa14-4109-897b-220d04d899fb None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:44.544348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7c229e27-aa14-4109-897b-220d04d899fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:44.555552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e0f4c-b399-434a-b6e9-2b382bd3a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:44.556388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e0f4c-b399-434a-b6e9-2b382bd3a544 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:44.556677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e0f4c-b399-434a-b6e9-2b382bd3a544 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:44.556960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e0f4c-b399-434a-b6e9-2b382bd3a544 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:44.575650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e0f4c-b399-434a-b6e9-2b382bd3a544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-568e0f4c-b399-434a-b6e9-2b382bd3a544 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:44.586374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:44.588959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:44.590999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 50/105] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:44.597391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e0f4c-b399-434a-b6e9-2b382bd3a544 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:44.674384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 56/106] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:40:44.746706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229e27-aa14-4109-897b-220d04d899fb None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:44.785594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e0f4c-b399-434a-b6e9-2b382bd3a544 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:44.825166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:44.826395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:44.826927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:44.827444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:44.828585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:44.828903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:44.830379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:44.843359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 51/107] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:44.849722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:44.860970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229e27-aa14-4109-897b-220d04d899fb None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:44.899320 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fece23-d8e5-4f76-8a9b-fa0e8c3e7393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:44.900187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fece23-d8e5-4f76-8a9b-fa0e8c3e7393 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:44.900481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fece23-d8e5-4f76-8a9b-fa0e8c3e7393 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:44.900761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fece23-d8e5-4f76-8a9b-fa0e8c3e7393 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:44.913485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fece23-d8e5-4f76-8a9b-fa0e8c3e7393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-18fece23-d8e5-4f76-8a9b-fa0e8c3e7393 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:44.921445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:44.923585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:44.925521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 57/108] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:40:44.936353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fece23-d8e5-4f76-8a9b-fa0e8c3e7393 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:44.976629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d75a8d-9593-4eae-97d6-a57bcd4aaa0b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:45.015986 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90530b-e2f0-4224-8cc1-c39ec1d05d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:45.017309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90530b-e2f0-4224-8cc1-c39ec1d05d3c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.017822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90530b-e2f0-4224-8cc1-c39ec1d05d3c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.018293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90530b-e2f0-4224-8cc1-c39ec1d05d3c None admin] PATH_INFO: `/v3/users/0163c4ddcb794e8c9370a33b56eb5526` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.034187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90530b-e2f0-4224-8cc1-c39ec1d05d3c None admin] RBAC: Authorizing `identity:get_user(user_id=0163c4ddcb794e8c9370a33b56eb5526)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:45.036640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90530b-e2f0-4224-8cc1-c39ec1d05d3c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:45.039466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 52/109] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:44 2022] GET /identity/v3/users/0163c4ddcb794e8c9370a33b56eb5526 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:45.046846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90530b-e2f0-4224-8cc1-c39ec1d05d3c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:45.070154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fece23-d8e5-4f76-8a9b-fa0e8c3e7393 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:45.113123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:45.113892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.114249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.114529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.115430 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:45.115608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:45.117024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:45.133539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 58/110] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:45.155356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:45.194851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90530b-e2f0-4224-8cc1-c39ec1d05d3c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:45.309853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d65b95-484d-400a-9c75-0869c1b1ecdd None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:45.319451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c09b69-4e23-4262-9e08-8d49846e1f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:45.320171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c09b69-4e23-4262-9e08-8d49846e1f39 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.320504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c09b69-4e23-4262-9e08-8d49846e1f39 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.320790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c09b69-4e23-4262-9e08-8d49846e1f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.353997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd507c-3815-435e-b7b1-30cbf0ceb955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:45.355206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd507c-3815-435e-b7b1-30cbf0ceb955 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.355500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd507c-3815-435e-b7b1-30cbf0ceb955 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.355783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd507c-3815-435e-b7b1-30cbf0ceb955 None admin] PATH_INFO: `/v3/users/52cc28158c3e43a08acacdddef40ed48` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.357325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd507c-3815-435e-b7b1-30cbf0ceb955 None admin] RBAC: Authorizing `identity:get_user(user_id=52cc28158c3e43a08acacdddef40ed48)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:45.358835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd507c-3815-435e-b7b1-30cbf0ceb955 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:45.360552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 59/111] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:45 2022] GET /identity/v3/users/52cc28158c3e43a08acacdddef40ed48 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:45.367841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd507c-3815-435e-b7b1-30cbf0ceb955 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:45.493420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd507c-3815-435e-b7b1-30cbf0ceb955 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:45.506614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c09b69-4e23-4262-9e08-8d49846e1f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:45.508134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c09b69-4e23-4262-9e08-8d49846e1f39 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:45.531708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a794af2-1103-431b-a325-be8d588926f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:45.532633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a794af2-1103-431b-a325-be8d588926f1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.532979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a794af2-1103-431b-a325-be8d588926f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.533289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a794af2-1103-431b-a325-be8d588926f1 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.536119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a794af2-1103-431b-a325-be8d588926f1 None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:45.537639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a794af2-1103-431b-a325-be8d588926f1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:45.539447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 60/112] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:45 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:45.548009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a794af2-1103-431b-a325-be8d588926f1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:45.751566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 53/113] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:40:45.753011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5cff-f059-4b95-b873-84e2f2a3cf54 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.753375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5cff-f059-4b95-b873-84e2f2a3cf54 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.753665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5cff-f059-4b95-b873-84e2f2a3cf54 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.765529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 54/114] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:45 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:45.766760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d5cff-f059-4b95-b873-84e2f2a3cf54 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:45.823149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a794af2-1103-431b-a325-be8d588926f1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:45.859478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33c319-88c6-425a-9690-860708849afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:45.860653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33c319-88c6-425a-9690-860708849afc None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.861083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33c319-88c6-425a-9690-860708849afc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.861534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33c319-88c6-425a-9690-860708849afc None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960/users/52cc28158c3e43a08acacdddef40ed48/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.863739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33c319-88c6-425a-9690-860708849afc None admin] RBAC: Authorizing `identity:create_grant(project_id=a115aa26e75244d4a57940a1d2497960, user_id=52cc28158c3e43a08acacdddef40ed48, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:45.865746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33c319-88c6-425a-9690-860708849afc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:45.904461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d5cff-f059-4b95-b873-84e2f2a3cf54 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:45.938133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c143b-b90c-43f3-a725-20e1cdd728db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:45.939163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c143b-b90c-43f3-a725-20e1cdd728db None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.939446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c143b-b90c-43f3-a725-20e1cdd728db None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.939719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c143b-b90c-43f3-a725-20e1cdd728db None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.940948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c143b-b90c-43f3-a725-20e1cdd728db None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:45.943072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c143b-b90c-43f3-a725-20e1cdd728db None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:45.944809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 55/115] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:45 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:45.945998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530b35-2886-448c-914f-90e912319cf6 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.946251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530b35-2886-448c-914f-90e912319cf6 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.946527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530b35-2886-448c-914f-90e912319cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.963155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-05530b35-2886-448c-914f-90e912319cf6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:45.964334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-05530b35-2886-448c-914f-90e912319cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:45.967945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 61/116] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:40:45 2022] PUT /identity/v3/projects/a115aa26e75244d4a57940a1d2497960/users/52cc28158c3e43a08acacdddef40ed48/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:40:45.970461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab7736-8345-4ae7-89b9-67861736cf83 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.971028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab7736-8345-4ae7-89b9-67861736cf83 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.971511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab7736-8345-4ae7-89b9-67861736cf83 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.973459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 62/117] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:45.975974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72effa92-a97b-44a4-bdbc-2991e9a741d9 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.976492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72effa92-a97b-44a4-bdbc-2991e9a741d9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.979519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72effa92-a97b-44a4-bdbc-2991e9a741d9 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.980174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 63/118] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:45.981189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72effa92-a97b-44a4-bdbc-2991e9a741d9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:46.063339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 56/119] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:46.065654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9d227-c7fb-40ee-957e-a8a9b1bb26f0 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:46.066154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9d227-c7fb-40ee-957e-a8a9b1bb26f0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:46.066783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9d227-c7fb-40ee-957e-a8a9b1bb26f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:46.088906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-54e9d227-c7fb-40ee-957e-a8a9b1bb26f0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:46.091152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-54e9d227-c7fb-40ee-957e-a8a9b1bb26f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:46.120431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72effa92-a97b-44a4-bdbc-2991e9a741d9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:46.164406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532ed45-8750-4d1c-8c64-9a093f110e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:46.165450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532ed45-8750-4d1c-8c64-9a093f110e7e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:46.166005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532ed45-8750-4d1c-8c64-9a093f110e7e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:46.166468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532ed45-8750-4d1c-8c64-9a093f110e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:46.167858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532ed45-8750-4d1c-8c64-9a093f110e7e None admin] RBAC: Adding query filter params (role.id=f0fe679843d746969573ffe11d85ee3b, scope.project.id=a115aa26e75244d4a57940a1d2497960, user.id=0163c4ddcb794e8c9370a33b56eb5526) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:46.168447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532ed45-8750-4d1c-8c64-9a093f110e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:46.170351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532ed45-8750-4d1c-8c64-9a093f110e7e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:46.177544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 64/120] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:45 2022] GET /identity/v3/role_assignments?user.id=0163c4ddcb794e8c9370a33b56eb5526&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=f0fe679843d746969573ffe11d85ee3b => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:46.179595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2da4-0604-4de5-9480-0680fbb5c028 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:46.180230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2da4-0604-4de5-9480-0680fbb5c028 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:46.180848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2da4-0604-4de5-9480-0680fbb5c028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:46.196480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 57/121] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:46.197631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9d227-c7fb-40ee-957e-a8a9b1bb26f0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:46.208951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d5fc2da4-0604-4de5-9480-0680fbb5c028 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:46.211049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d5fc2da4-0604-4de5-9480-0680fbb5c028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:46.297436 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 65/122] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:46.298967 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc2da4-0604-4de5-9480-0680fbb5c028 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:46.326249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9d227-c7fb-40ee-957e-a8a9b1bb26f0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:46.386885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7eb1-4821-40fc-bd84-1af5259092b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:46.387777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7eb1-4821-40fc-bd84-1af5259092b7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:46.388061 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7eb1-4821-40fc-bd84-1af5259092b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:46.388337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7eb1-4821-40fc-bd84-1af5259092b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:46.411757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c7eb1-4821-40fc-bd84-1af5259092b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-6e6c7eb1-4821-40fc-bd84-1af5259092b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:46.429478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:46.430393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:46.431120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:46.438150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 58/123] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:40:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:46.439276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7eb1-4821-40fc-bd84-1af5259092b7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:46.503459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc2da4-0604-4de5-9480-0680fbb5c028 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:46.550075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada505b5-5461-4566-ba3b-72dee61bff2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:46.553203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada505b5-5461-4566-ba3b-72dee61bff2d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:46.553510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada505b5-5461-4566-ba3b-72dee61bff2d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:46.553787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada505b5-5461-4566-ba3b-72dee61bff2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:46.578978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada505b5-5461-4566-ba3b-72dee61bff2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-ada505b5-5461-4566-ba3b-72dee61bff2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:46.595448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:46.596353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 66/124] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:46.597549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada505b5-5461-4566-ba3b-72dee61bff2d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:46.654946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7eb1-4821-40fc-bd84-1af5259092b7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:46.718290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817de38a-4f58-4a2d-afd2-f10e5321a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:46.719100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817de38a-4f58-4a2d-afd2-f10e5321a026 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:46.719384 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817de38a-4f58-4a2d-afd2-f10e5321a026 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:46.719664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817de38a-4f58-4a2d-afd2-f10e5321a026 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:46.744989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817de38a-4f58-4a2d-afd2-f10e5321a026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-817de38a-4f58-4a2d-afd2-f10e5321a026 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:46.755906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:46.757218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:46.758002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:46.759185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 59/125] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:46.759723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817de38a-4f58-4a2d-afd2-f10e5321a026 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:46.772366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada505b5-5461-4566-ba3b-72dee61bff2d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:46.835429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:46.836143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:46.836397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:46.836676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:46.837474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:46.837786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:46.839180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:46.853452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 67/126] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:40:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:46.854566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:46.960596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817de38a-4f58-4a2d-afd2-f10e5321a026 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.016158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.016836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.017122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.017429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.018193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] RBAC: Adding query filter params (name=member) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:47.018504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.019886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.040946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 60/127] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:47.041862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.047361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc993f42-a87f-454f-936e-93774f2b9a76 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.119878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.120491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.120779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.121060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.121852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:47.122164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.123560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.132658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 68/128] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:47.137657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.183703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b65aa-1fd8-4fd9-9e7a-7eb070f2ba70 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.221559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57b24-5483-431a-8e37-6fcf27569b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.223008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57b24-5483-431a-8e37-6fcf27569b18 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.223540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57b24-5483-431a-8e37-6fcf27569b18 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.224083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57b24-5483-431a-8e37-6fcf27569b18 None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.225881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d57b24-5483-431a-8e37-6fcf27569b18 None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.227565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d57b24-5483-431a-8e37-6fcf27569b18 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.229705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 61/129] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:47 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:47.230804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57b24-5483-431a-8e37-6fcf27569b18 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.241630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6923824-199a-41fb-b3c6-599fc540828a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.290021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e87ab-5a47-42cf-82d4-677245d679b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.290921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e87ab-5a47-42cf-82d4-677245d679b7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.291212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e87ab-5a47-42cf-82d4-677245d679b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.291493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e87ab-5a47-42cf-82d4-677245d679b7 None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.292807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e87ab-5a47-42cf-82d4-677245d679b7 None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.294298 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e87ab-5a47-42cf-82d4-677245d679b7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.295946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 69/130] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:47 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:47.296723 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e87ab-5a47-42cf-82d4-677245d679b7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.342547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57b24-5483-431a-8e37-6fcf27569b18 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.379201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96017f-93c6-428c-b0ee-85e536811561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.381549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96017f-93c6-428c-b0ee-85e536811561 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.382030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96017f-93c6-428c-b0ee-85e536811561 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.382539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96017f-93c6-428c-b0ee-85e536811561 None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.383993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96017f-93c6-428c-b0ee-85e536811561 None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.385817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96017f-93c6-428c-b0ee-85e536811561 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.387658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 62/131] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:47 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:47.388716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96017f-93c6-428c-b0ee-85e536811561 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.441707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e87ab-5a47-42cf-82d4-677245d679b7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.498022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef12a52-dc69-4e22-a4d6-4e057b95e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.498972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef12a52-dc69-4e22-a4d6-4e057b95e07d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.499263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef12a52-dc69-4e22-a4d6-4e057b95e07d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.499544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef12a52-dc69-4e22-a4d6-4e057b95e07d None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.500815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef12a52-dc69-4e22-a4d6-4e057b95e07d None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.502301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef12a52-dc69-4e22-a4d6-4e057b95e07d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.504053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 70/132] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:47 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:47.505724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef12a52-dc69-4e22-a4d6-4e057b95e07d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.545637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96017f-93c6-428c-b0ee-85e536811561 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.589771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dfd9a-50e7-420a-bbee-12418d7d7c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.590691 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfd9a-50e7-420a-bbee-12418d7d7c59 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.590973 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfd9a-50e7-420a-bbee-12418d7d7c59 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.591248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfd9a-50e7-420a-bbee-12418d7d7c59 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.593104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dfd9a-50e7-420a-bbee-12418d7d7c59 None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.594586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dfd9a-50e7-420a-bbee-12418d7d7c59 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.597173 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 63/133] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:47 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:47.604680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dfd9a-50e7-420a-bbee-12418d7d7c59 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.647873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef12a52-dc69-4e22-a4d6-4e057b95e07d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.686916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4410ff-da0d-4896-b86c-2051e120eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.688209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4410ff-da0d-4896-b86c-2051e120eb20 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.688754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4410ff-da0d-4896-b86c-2051e120eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.689259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4410ff-da0d-4896-b86c-2051e120eb20 None admin] PATH_INFO: `/v3/projects/df73c25db1f74cdca0e22fe67f82a359` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.692160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4410ff-da0d-4896-b86c-2051e120eb20 None admin] RBAC: Authorizing `identity:get_project(project_id=df73c25db1f74cdca0e22fe67f82a359)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.694529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4410ff-da0d-4896-b86c-2051e120eb20 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.696788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 71/134] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:47 2022] GET /identity/v3/projects/df73c25db1f74cdca0e22fe67f82a359 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:47.698522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be8c63-ad2e-41a5-9154-d4fe0013922d None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.699027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be8c63-ad2e-41a5-9154-d4fe0013922d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.699509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be8c63-ad2e-41a5-9154-d4fe0013922d None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.701060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 72/135] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:47.706329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be8c63-ad2e-41a5-9154-d4fe0013922d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.727324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dfd9a-50e7-420a-bbee-12418d7d7c59 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.766406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6ed0-5253-4021-9534-af449ca43dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.767663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6ed0-5253-4021-9534-af449ca43dd1 None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.767663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6ed0-5253-4021-9534-af449ca43dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.767830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6ed0-5253-4021-9534-af449ca43dd1 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960/users/84dac3517ebe4f76ae9dfbd924114efe/roles/597c56383ca9464ca3bf4ae47dbf7716` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.770985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6ed0-5253-4021-9534-af449ca43dd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a115aa26e75244d4a57940a1d2497960, user_id=84dac3517ebe4f76ae9dfbd924114efe, role_id=597c56383ca9464ca3bf4ae47dbf7716)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.772531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6ed0-5253-4021-9534-af449ca43dd1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.830015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be8c63-ad2e-41a5-9154-d4fe0013922d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:47.881686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 64/136] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:40:47 2022] PUT /identity/v3/projects/a115aa26e75244d4a57940a1d2497960/users/84dac3517ebe4f76ae9dfbd924114efe/roles/597c56383ca9464ca3bf4ae47dbf7716 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:40:47.882306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c3fc-09f7-4c7c-8204-b57d1bff2ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:47.883331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c3fc-09f7-4c7c-8204-b57d1bff2ce3 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.883615 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c3fc-09f7-4c7c-8204-b57d1bff2ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.883940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c3fc-09f7-4c7c-8204-b57d1bff2ce3 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960/users/84dac3517ebe4f76ae9dfbd924114efe/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:47.884344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6ed0-5253-4021-9534-af449ca43dd1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:47.886209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5c3fc-09f7-4c7c-8204-b57d1bff2ce3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a115aa26e75244d4a57940a1d2497960, user_id=84dac3517ebe4f76ae9dfbd924114efe, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:47.887708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5c3fc-09f7-4c7c-8204-b57d1bff2ce3 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:47.964492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 73/137] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:40:47 2022] PUT /identity/v3/projects/a115aa26e75244d4a57940a1d2497960/users/84dac3517ebe4f76ae9dfbd924114efe/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:40:47.965701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9ac3-df17-4e6b-af97-b9133acd5a67 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:47.971031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9ac3-df17-4e6b-af97-b9133acd5a67 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:47.971031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9ac3-df17-4e6b-af97-b9133acd5a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:48.007570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-019a9ac3-df17-4e6b-af97-b9133acd5a67 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:48.013296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-019a9ac3-df17-4e6b-af97-b9133acd5a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:48.074375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6ed0-5253-4021-9534-af449ca43dd1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:48.117807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263c758-146b-4405-b046-06d13d502769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:48.120100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c758-146b-4405-b046-06d13d502769 None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:48.120100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c758-146b-4405-b046-06d13d502769 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:48.120100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c758-146b-4405-b046-06d13d502769 None admin] PATH_INFO: `/v3/projects/df73c25db1f74cdca0e22fe67f82a359/users/84dac3517ebe4f76ae9dfbd924114efe/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:48.121826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263c758-146b-4405-b046-06d13d502769 None admin] RBAC: Authorizing `identity:create_grant(project_id=df73c25db1f74cdca0e22fe67f82a359, user_id=84dac3517ebe4f76ae9dfbd924114efe, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:48.123483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263c758-146b-4405-b046-06d13d502769 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:48.180668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 74/138] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:48.191815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 65/139] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:40:47 2022] PUT /identity/v3/projects/df73c25db1f74cdca0e22fe67f82a359/users/84dac3517ebe4f76ae9dfbd924114efe/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:40:48.218053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a9ac3-df17-4e6b-af97-b9133acd5a67 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:48.354651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a9ac3-df17-4e6b-af97-b9133acd5a67 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:48.405910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4558-e603-4f63-ba08-de58612f4047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:48.406951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4558-e603-4f63-ba08-de58612f4047 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:48.407342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4558-e603-4f63-ba08-de58612f4047 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:48.407745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4558-e603-4f63-ba08-de58612f4047 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:48.409165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4558-e603-4f63-ba08-de58612f4047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:48.410843 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4558-e603-4f63-ba08-de58612f4047 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:48.413389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 75/140] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:48.421322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263c758-146b-4405-b046-06d13d502769 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:48.543968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263c758-146b-4405-b046-06d13d502769 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:48.588855 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74223406-85d3-4db8-b460-6cef77334d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:48.589761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223406-85d3-4db8-b460-6cef77334d53 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:48.590150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223406-85d3-4db8-b460-6cef77334d53 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:48.590608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223406-85d3-4db8-b460-6cef77334d53 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:48.591439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74223406-85d3-4db8-b460-6cef77334d53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:48.593015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74223406-85d3-4db8-b460-6cef77334d53 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:48.712256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 66/141] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:40:48 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:49.081123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8cdb4-1693-4d34-9d45-22c5d3d5ebff None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:49.081676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8cdb4-1693-4d34-9d45-22c5d3d5ebff None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:49.081990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8cdb4-1693-4d34-9d45-22c5d3d5ebff None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:49.084356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 76/142] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:49.092125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce937-aa74-434e-99ab-3de04356d851 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:49.092621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce937-aa74-434e-99ab-3de04356d851 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:49.092693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce937-aa74-434e-99ab-3de04356d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:49.106825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609807d-ae10-474d-ac0e-efb369201737 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:49.107128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609807d-ae10-474d-ac0e-efb369201737 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:49.107388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609807d-ae10-474d-ac0e-efb369201737 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:49.108774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 77/143] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:40:49.117366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-320ce937-aa74-434e-99ab-3de04356d851 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:49.118688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-320ce937-aa74-434e-99ab-3de04356d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:49.123990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772b26-400f-458d-b013-d40f9a12c22b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:49.124281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772b26-400f-458d-b013-d40f9a12c22b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:49.124565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2772b26-400f-458d-b013-d40f9a12c22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:49.151291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a2772b26-400f-458d-b013-d40f9a12c22b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:49.152493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a2772b26-400f-458d-b013-d40f9a12c22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:49.254379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 67/144] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:49.275304 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 78/145] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:40:49.289978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce937-aa74-434e-99ab-3de04356d851 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:49.336278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2772b26-400f-458d-b013-d40f9a12c22b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:49.423070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce937-aa74-434e-99ab-3de04356d851 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:49.464308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4a17d-f393-4f4c-bed7-f45cfe62e39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:49.465269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4a17d-f393-4f4c-bed7-f45cfe62e39b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:49.465670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4a17d-f393-4f4c-bed7-f45cfe62e39b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:49.465960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4a17d-f393-4f4c-bed7-f45cfe62e39b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:49.478262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4a17d-f393-4f4c-bed7-f45cfe62e39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:49.483415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2772b26-400f-458d-b013-d40f9a12c22b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-eaa4a17d-f393-4f4c-bed7-f45cfe62e39b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:49.487406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:49.488271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:49.489593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 68/146] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:49.500505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4a17d-f393-4f4c-bed7-f45cfe62e39b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:49.570966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f6bb6-6dee-4732-a916-dee774689bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:49.571809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f6bb6-6dee-4732-a916-dee774689bf7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:49.572096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f6bb6-6dee-4732-a916-dee774689bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:49.572379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f6bb6-6dee-4732-a916-dee774689bf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:49.605606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f6bb6-6dee-4732-a916-dee774689bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-407f6bb6-6dee-4732-a916-dee774689bf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:49.623525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:49.624550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:49.625406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 79/147] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:40:49.659330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f6bb6-6dee-4732-a916-dee774689bf7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:49.691829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4a17d-f393-4f4c-bed7-f45cfe62e39b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:49.750747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:49.751442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:49.751727 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:49.752005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:49.753069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:49.753413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:49.756352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:49.775816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 69/148] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:49.779998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:49.827446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f6bb6-6dee-4732-a916-dee774689bf7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:49.872755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:49.873809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:49.874306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:49.874781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:49.875767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:49.876273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:49.877881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:49.896018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 80/149] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:49.903009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:49.999259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9196f-c19a-4e64-baa9-84e46a473c28 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:50.069943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665cd5b-75eb-4e5c-911d-97801ca0aaf2 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:50.078682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee868fb-f59e-44c4-8cf0-cf3da61ed573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:50.079586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee868fb-f59e-44c4-8cf0-cf3da61ed573 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:50.079874 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee868fb-f59e-44c4-8cf0-cf3da61ed573 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:50.080155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee868fb-f59e-44c4-8cf0-cf3da61ed573 None admin] PATH_INFO: `/v3/users/0163c4ddcb794e8c9370a33b56eb5526` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:50.086200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee868fb-f59e-44c4-8cf0-cf3da61ed573 None admin] RBAC: Authorizing `identity:get_user(user_id=0163c4ddcb794e8c9370a33b56eb5526)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:50.087665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee868fb-f59e-44c4-8cf0-cf3da61ed573 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:50.090017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 70/150] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:49 2022] GET /identity/v3/users/0163c4ddcb794e8c9370a33b56eb5526 => generated 289 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:50.095440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee868fb-f59e-44c4-8cf0-cf3da61ed573 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:50.117916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0a9a0-7d98-4fb6-9e9a-7ec524dc65cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:50.119628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a9a0-7d98-4fb6-9e9a-7ec524dc65cc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:50.120111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a9a0-7d98-4fb6-9e9a-7ec524dc65cc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:50.120638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a9a0-7d98-4fb6-9e9a-7ec524dc65cc None admin] PATH_INFO: `/v3/users/52cc28158c3e43a08acacdddef40ed48` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:50.122193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0a9a0-7d98-4fb6-9e9a-7ec524dc65cc None admin] RBAC: Authorizing `identity:get_user(user_id=52cc28158c3e43a08acacdddef40ed48)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:50.124098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0a9a0-7d98-4fb6-9e9a-7ec524dc65cc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:50.127862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 81/151] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:49 2022] GET /identity/v3/users/52cc28158c3e43a08acacdddef40ed48 => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:50.135057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0a9a0-7d98-4fb6-9e9a-7ec524dc65cc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:50.259399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0a9a0-7d98-4fb6-9e9a-7ec524dc65cc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:50.297963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c7b1-53bd-4b63-96bd-b2ea49f19b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:50.299001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c7b1-53bd-4b63-96bd-b2ea49f19b12 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:50.299484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c7b1-53bd-4b63-96bd-b2ea49f19b12 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:50.299958 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c7b1-53bd-4b63-96bd-b2ea49f19b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:50.355609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee868fb-f59e-44c4-8cf0-cf3da61ed573 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:50.424681 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda64ee-71c1-4afe-ae98-fb7b7517d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:50.425495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda64ee-71c1-4afe-ae98-fb7b7517d823 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:50.425787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda64ee-71c1-4afe-ae98-fb7b7517d823 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:50.426067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda64ee-71c1-4afe-ae98-fb7b7517d823 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:50.428187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda64ee-71c1-4afe-ae98-fb7b7517d823 None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:50.429682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda64ee-71c1-4afe-ae98-fb7b7517d823 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:50.431777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 71/152] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:50 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:50.437634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda64ee-71c1-4afe-ae98-fb7b7517d823 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:50.443777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c7b1-53bd-4b63-96bd-b2ea49f19b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:50.446403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c7b1-53bd-4b63-96bd-b2ea49f19b12 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:50.618068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 82/153] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:40:50.624282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c7b1-53bd-4b63-96bd-b2ea49f19b12 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:50.697092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda64ee-71c1-4afe-ae98-fb7b7517d823 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:50.748565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c7b1-53bd-4b63-96bd-b2ea49f19b12 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:50.758634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17e3fc-31c0-4d85-ac39-15ea4af2e3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:50.759750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e3fc-31c0-4d85-ac39-15ea4af2e3af None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:50.759857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e3fc-31c0-4d85-ac39-15ea4af2e3af None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:50.760101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e3fc-31c0-4d85-ac39-15ea4af2e3af None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960/users/0163c4ddcb794e8c9370a33b56eb5526/roles/f0fe679843d746969573ffe11d85ee3b` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:50.762151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17e3fc-31c0-4d85-ac39-15ea4af2e3af None admin] RBAC: Authorizing `identity:create_grant(project_id=a115aa26e75244d4a57940a1d2497960, user_id=0163c4ddcb794e8c9370a33b56eb5526, role_id=f0fe679843d746969573ffe11d85ee3b)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:50.763734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17e3fc-31c0-4d85-ac39-15ea4af2e3af None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:50.792540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7faf6-acc0-431e-8d41-aecbe3c6d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:50.793792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7faf6-acc0-431e-8d41-aecbe3c6d654 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:50.794280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7faf6-acc0-431e-8d41-aecbe3c6d654 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:50.794756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7faf6-acc0-431e-8d41-aecbe3c6d654 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:50.798045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7faf6-acc0-431e-8d41-aecbe3c6d654 None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:50.799757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7faf6-acc0-431e-8d41-aecbe3c6d654 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:50.802713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 83/154] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:50 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:50.808584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7faf6-acc0-431e-8d41-aecbe3c6d654 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:50.854162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 72/155] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:40:50 2022] PUT /identity/v3/projects/a115aa26e75244d4a57940a1d2497960/users/0163c4ddcb794e8c9370a33b56eb5526/roles/f0fe679843d746969573ffe11d85ee3b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:40:50.922976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7faf6-acc0-431e-8d41-aecbe3c6d654 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:50.965194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d299b-5fcb-459b-8435-999dacecec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:50.966241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d299b-5fcb-459b-8435-999dacecec01 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:50.966787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d299b-5fcb-459b-8435-999dacecec01 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:50.967271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d299b-5fcb-459b-8435-999dacecec01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:50.968390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d299b-5fcb-459b-8435-999dacecec01 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=a115aa26e75244d4a57940a1d2497960, user.id=52cc28158c3e43a08acacdddef40ed48) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:50.968957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d299b-5fcb-459b-8435-999dacecec01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:50.970834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d299b-5fcb-459b-8435-999dacecec01 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:50.978699 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 84/156] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:50 2022] GET /identity/v3/role_assignments?user.id=52cc28158c3e43a08acacdddef40ed48&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=f1d6bdc882c24a2a9389961135865317 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:51.806831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fc224-c9b6-4d74-8466-7b51778dc14f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.807818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fc224-c9b6-4d74-8466-7b51778dc14f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.808303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fc224-c9b6-4d74-8466-7b51778dc14f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.809939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 73/157] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:51.815709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8cab-9812-40f4-8a30-d91d8e4db5aa None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.816218 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8cab-9812-40f4-8a30-d91d8e4db5aa None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.816293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea8cab-9812-40f4-8a30-d91d8e4db5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.838338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d0ea8cab-9812-40f4-8a30-d91d8e4db5aa None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:51.839866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d0ea8cab-9812-40f4-8a30-d91d8e4db5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:51.938064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 85/158] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:51.951655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8672b3-fdc0-4dd9-b1ea-fbc83cfa80e9 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.952276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8672b3-fdc0-4dd9-b1ea-fbc83cfa80e9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.952757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8672b3-fdc0-4dd9-b1ea-fbc83cfa80e9 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.954372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 74/159] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:51.960698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8615-a874-47eb-b8ba-60a3e12c2450 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.961326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8615-a874-47eb-b8ba-60a3e12c2450 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.961828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b8615-a874-47eb-b8ba-60a3e12c2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.967931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8672b3-fdc0-4dd9-b1ea-fbc83cfa80e9 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:52.006133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1f1b8615-a874-47eb-b8ba-60a3e12c2450 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:52.009117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1f1b8615-a874-47eb-b8ba-60a3e12c2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:52.161711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 86/160] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:52.161711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63bccf-57ff-4d24-8f0c-3253a12e3d08 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:52.161711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63bccf-57ff-4d24-8f0c-3253a12e3d08 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:52.162034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63bccf-57ff-4d24-8f0c-3253a12e3d08 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:52.163186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 87/161] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:52.172963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed57c-d9fe-466c-a3b3-7aa3e288d474 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:52.173264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed57c-d9fe-466c-a3b3-7aa3e288d474 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:52.173544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bed57c-d9fe-466c-a3b3-7aa3e288d474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:52.200466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-18bed57c-d9fe-466c-a3b3-7aa3e288d474 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:52.202107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8672b3-fdc0-4dd9-b1ea-fbc83cfa80e9 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:52.204375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-18bed57c-d9fe-466c-a3b3-7aa3e288d474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:52.262694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c684b6-3963-4136-8e7a-6015679fdc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:52.263422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c684b6-3963-4136-8e7a-6015679fdc55 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:52.263704 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c684b6-3963-4136-8e7a-6015679fdc55 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:52.263980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c684b6-3963-4136-8e7a-6015679fdc55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:52.286122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c684b6-3963-4136-8e7a-6015679fdc55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-b1c684b6-3963-4136-8e7a-6015679fdc55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:52.297157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:52.298064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:52.298916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 75/162] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:40:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:40:52.299553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c684b6-3963-4136-8e7a-6015679fdc55 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:52.332375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 88/163] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:52.333421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bed57c-d9fe-466c-a3b3-7aa3e288d474 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:52.460460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bed57c-d9fe-466c-a3b3-7aa3e288d474 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:52.503133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:52.503830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:52.504109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:52.504383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:52.505645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:52.506599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:52.509542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:52.529706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 89/164] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:40:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:52.530587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c684b6-3963-4136-8e7a-6015679fdc55 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:52.531293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:52.609627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cba4d-aa9f-4ee3-820a-ec9e0b183eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:52.610526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cba4d-aa9f-4ee3-820a-ec9e0b183eaf None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:52.610818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cba4d-aa9f-4ee3-820a-ec9e0b183eaf None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:52.611154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cba4d-aa9f-4ee3-820a-ec9e0b183eaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:52.625093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cba4d-aa9f-4ee3-820a-ec9e0b183eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-eb1cba4d-aa9f-4ee3-820a-ec9e0b183eaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:52.636910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:52.637961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:52.638723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 76/165] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:52.639370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cba4d-aa9f-4ee3-820a-ec9e0b183eaf None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:52.681745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc42a1-341d-4a83-8701-0df8e02264d0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:52.728078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d953-5b32-4d53-acc6-cb0890c4ce38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:52.729694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d953-5b32-4d53-acc6-cb0890c4ce38 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:52.730334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d953-5b32-4d53-acc6-cb0890c4ce38 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:52.730660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d953-5b32-4d53-acc6-cb0890c4ce38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:52.747199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888d953-5b32-4d53-acc6-cb0890c4ce38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:52.751320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cba4d-aa9f-4ee3-820a-ec9e0b183eaf None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-d888d953-5b32-4d53-acc6-cb0890c4ce38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:52.757568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:52.759198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 90/166] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:52.760986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d953-5b32-4d53-acc6-cb0890c4ce38 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:52.791896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24358cde-de11-4012-b0ec-f41b16e9290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:52.792865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24358cde-de11-4012-b0ec-f41b16e9290c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:52.793265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24358cde-de11-4012-b0ec-f41b16e9290c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:52.793598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24358cde-de11-4012-b0ec-f41b16e9290c None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:52.794871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24358cde-de11-4012-b0ec-f41b16e9290c None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:52.796375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24358cde-de11-4012-b0ec-f41b16e9290c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:52.798336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 77/167] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:52 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:52.799128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24358cde-de11-4012-b0ec-f41b16e9290c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:52.964547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d953-5b32-4d53-acc6-cb0890c4ce38 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:53.007586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24358cde-de11-4012-b0ec-f41b16e9290c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:53.009277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:53.009942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.009942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.010930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.011119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:53.011486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:53.012956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:53.022988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 91/168] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:53.024021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:53.085394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:53.086383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.086873 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.087313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.088254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] RBAC: Adding query filter params (name=member) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:53.088738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:53.090330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:53.108719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 78/169] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:53.109871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:53.212152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb09c-2708-41a5-963d-330aa74ccb30 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:53.256192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8255e-9bfb-4388-932b-4f0e27c4623c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:53.294131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d493-3479-461c-8c36-81fc148ad524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:53.295044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d493-3479-461c-8c36-81fc148ad524 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.295330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d493-3479-461c-8c36-81fc148ad524 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.295605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d493-3479-461c-8c36-81fc148ad524 None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.296824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76d493-3479-461c-8c36-81fc148ad524 None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:53.298349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76d493-3479-461c-8c36-81fc148ad524 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:53.299996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 79/170] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:53 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:53.300818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d493-3479-461c-8c36-81fc148ad524 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:53.302035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22167b60-00ef-432d-bc8c-73a331bcdfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:53.302908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22167b60-00ef-432d-bc8c-73a331bcdfb3 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.303191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22167b60-00ef-432d-bc8c-73a331bcdfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.303469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22167b60-00ef-432d-bc8c-73a331bcdfb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.417425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d493-3479-461c-8c36-81fc148ad524 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:53.450311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22167b60-00ef-432d-bc8c-73a331bcdfb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:53.451795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22167b60-00ef-432d-bc8c-73a331bcdfb3 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:53.456034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0103-8895-41f4-a340-49d9c9b61f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:53.456926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0103-8895-41f4-a340-49d9c9b61f7f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.457213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0103-8895-41f4-a340-49d9c9b61f7f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.457548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0103-8895-41f4-a340-49d9c9b61f7f None admin] PATH_INFO: `/v3/users/84dac3517ebe4f76ae9dfbd924114efe` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.459719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0103-8895-41f4-a340-49d9c9b61f7f None admin] RBAC: Authorizing `identity:get_user(user_id=84dac3517ebe4f76ae9dfbd924114efe)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:53.461261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0103-8895-41f4-a340-49d9c9b61f7f None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:53.462940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 80/171] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:53 2022] GET /identity/v3/users/84dac3517ebe4f76ae9dfbd924114efe => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:53.463758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0103-8895-41f4-a340-49d9c9b61f7f None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:53.576525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0103-8895-41f4-a340-49d9c9b61f7f None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:53.608008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 92/172] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:53.609229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22167b60-00ef-432d-bc8c-73a331bcdfb3 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:53.623178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7793ed0-c369-4302-8155-bbe1455a2c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:53.624125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7793ed0-c369-4302-8155-bbe1455a2c2d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.624414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7793ed0-c369-4302-8155-bbe1455a2c2d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.624697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7793ed0-c369-4302-8155-bbe1455a2c2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.726219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22167b60-00ef-432d-bc8c-73a331bcdfb3 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:53.762825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7793ed0-c369-4302-8155-bbe1455a2c2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:53.765280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7793ed0-c369-4302-8155-bbe1455a2c2d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:53.768390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e66bc-d168-4240-88e7-90ad0f47f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:53.769058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e66bc-d168-4240-88e7-90ad0f47f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.769377 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e66bc-d168-4240-88e7-90ad0f47f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.769842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e66bc-d168-4240-88e7-90ad0f47f0a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.886279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e66bc-d168-4240-88e7-90ad0f47f0a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:53.887819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e66bc-d168-4240-88e7-90ad0f47f0a5 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:53.939578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 81/173] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:53.940739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7793ed0-c369-4302-8155-bbe1455a2c2d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:53.996876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 93/174] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:53.998524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e66bc-d168-4240-88e7-90ad0f47f0a5 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:54.086567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7793ed0-c369-4302-8155-bbe1455a2c2d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:54.104176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e66bc-d168-4240-88e7-90ad0f47f0a5 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:54.124788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3af9b3-fdfa-4a03-b3c5-00acd5d3de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:54.131502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3af9b3-fdfa-4a03-b3c5-00acd5d3de2d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.131806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3af9b3-fdfa-4a03-b3c5-00acd5d3de2d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.132098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3af9b3-fdfa-4a03-b3c5-00acd5d3de2d None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.133709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3af9b3-fdfa-4a03-b3c5-00acd5d3de2d None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:54.135186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3af9b3-fdfa-4a03-b3c5-00acd5d3de2d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:54.137116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 82/175] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:53 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:54.137955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3af9b3-fdfa-4a03-b3c5-00acd5d3de2d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:54.146105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166a802-9d24-41ad-8049-73df4a285010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:54.147616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a802-9d24-41ad-8049-73df4a285010 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.148150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a802-9d24-41ad-8049-73df4a285010 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.148883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166a802-9d24-41ad-8049-73df4a285010 None admin] PATH_INFO: `/v3/projects/df73c25db1f74cdca0e22fe67f82a359` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.151514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166a802-9d24-41ad-8049-73df4a285010 None admin] RBAC: Authorizing `identity:get_project(project_id=df73c25db1f74cdca0e22fe67f82a359)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:54.154401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166a802-9d24-41ad-8049-73df4a285010 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:54.156927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 94/176] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:53 2022] GET /identity/v3/projects/df73c25db1f74cdca0e22fe67f82a359 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:54.158763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106618-2eaf-4b2e-990e-db9b3e5b6b25 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.159507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106618-2eaf-4b2e-990e-db9b3e5b6b25 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.160340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106618-2eaf-4b2e-990e-db9b3e5b6b25 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.164352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 95/177] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:54.166204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106618-2eaf-4b2e-990e-db9b3e5b6b25 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:54.272482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3af9b3-fdfa-4a03-b3c5-00acd5d3de2d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:54.277846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106618-2eaf-4b2e-990e-db9b3e5b6b25 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:54.314948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d1dea-3607-4987-8b27-9807ef9db636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:54.315150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2450e-c55f-4caa-9080-da4e2b9df78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:54.315812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2450e-c55f-4caa-9080-da4e2b9df78d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.316099 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2450e-c55f-4caa-9080-da4e2b9df78d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.316373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2450e-c55f-4caa-9080-da4e2b9df78d None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.316601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1dea-3607-4987-8b27-9807ef9db636 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.317145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1dea-3607-4987-8b27-9807ef9db636 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.317619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d1dea-3607-4987-8b27-9807ef9db636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.318251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2450e-c55f-4caa-9080-da4e2b9df78d None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:54.318829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d1dea-3607-4987-8b27-9807ef9db636 None admin] RBAC: Adding query filter params (role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=a115aa26e75244d4a57940a1d2497960, user.id=84dac3517ebe4f76ae9dfbd924114efe) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:54.319310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d1dea-3607-4987-8b27-9807ef9db636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:54.319694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2450e-c55f-4caa-9080-da4e2b9df78d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:54.321170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d1dea-3607-4987-8b27-9807ef9db636 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:54.321633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 83/178] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:54 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:54.322186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2450e-c55f-4caa-9080-da4e2b9df78d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:54.328863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 96/179] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:54 2022] GET /identity/v3/role_assignments?user.id=84dac3517ebe4f76ae9dfbd924114efe&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:54.330607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412863f2-4a36-45b1-96b3-ed6f4520f0cb None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.331098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412863f2-4a36-45b1-96b3-ed6f4520f0cb None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.331633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412863f2-4a36-45b1-96b3-ed6f4520f0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.350045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-412863f2-4a36-45b1-96b3-ed6f4520f0cb None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:54.351649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-412863f2-4a36-45b1-96b3-ed6f4520f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:54.426105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 97/180] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:54.428597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077538d-e6e7-4cc5-97bc-2ccbcd25b4ec None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.429109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077538d-e6e7-4cc5-97bc-2ccbcd25b4ec None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.429615 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077538d-e6e7-4cc5-97bc-2ccbcd25b4ec None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.431302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 98/181] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:54.432342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077538d-e6e7-4cc5-97bc-2ccbcd25b4ec None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:54.437577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2450e-c55f-4caa-9080-da4e2b9df78d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:54.490146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f4c11-bc43-48ac-ab4c-7426487ad194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:54.490834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4c11-bc43-48ac-ab4c-7426487ad194 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.491120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4c11-bc43-48ac-ab4c-7426487ad194 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.491403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f4c11-bc43-48ac-ab4c-7426487ad194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.492284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f4c11-bc43-48ac-ab4c-7426487ad194 None admin] RBAC: Adding query filter params (role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=df73c25db1f74cdca0e22fe67f82a359, user.id=84dac3517ebe4f76ae9dfbd924114efe) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:54.492602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f4c11-bc43-48ac-ab4c-7426487ad194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:54.494196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f4c11-bc43-48ac-ab4c-7426487ad194 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:54.501283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 84/182] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:54 2022] GET /identity/v3/role_assignments?user.id=84dac3517ebe4f76ae9dfbd924114efe&scope.project.id=df73c25db1f74cdca0e22fe67f82a359&role.id=68f91fa718f44020a307be6b2f10b834 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:54.511229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71919f48-10c9-4d6f-aeed-814ee8ee095f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.511229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71919f48-10c9-4d6f-aeed-814ee8ee095f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.511638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71919f48-10c9-4d6f-aeed-814ee8ee095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.542525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-71919f48-10c9-4d6f-aeed-814ee8ee095f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:54.543895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-71919f48-10c9-4d6f-aeed-814ee8ee095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:54.562571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077538d-e6e7-4cc5-97bc-2ccbcd25b4ec None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:54.603434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:54.604770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.606292 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.606292 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.607432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] RBAC: Adding query filter params (role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=a115aa26e75244d4a57940a1d2497960, user.id=84dac3517ebe4f76ae9dfbd924114efe) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:54.608019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:54.609782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:54.617759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 99/183] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:54 2022] GET /identity/v3/role_assignments?user.id=84dac3517ebe4f76ae9dfbd924114efe&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=68f91fa718f44020a307be6b2f10b834 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:54.619131 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:54.720588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 85/184] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:54.722541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f9972-a741-40ce-9eb4-b5b7583efdce None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.723040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f9972-a741-40ce-9eb4-b5b7583efdce None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.724151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f9972-a741-40ce-9eb4-b5b7583efdce None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.725780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 86/185] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:54.732657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257223-1fa5-48de-a447-1fdf79c6537f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.733274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257223-1fa5-48de-a447-1fdf79c6537f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.733747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257223-1fa5-48de-a447-1fdf79c6537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.754628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-cf257223-1fa5-48de-a447-1fdf79c6537f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:54.758647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-cf257223-1fa5-48de-a447-1fdf79c6537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:54.764958 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9504cba-b38b-4db2-b1a3-17615457275e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:54.814833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a440998-5d37-4afd-ad16-e5c178a27167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:54.815584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a440998-5d37-4afd-ad16-e5c178a27167 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.815864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a440998-5d37-4afd-ad16-e5c178a27167 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.816137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a440998-5d37-4afd-ad16-e5c178a27167 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.828260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a440998-5d37-4afd-ad16-e5c178a27167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-5a440998-5d37-4afd-ad16-e5c178a27167 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:54.837177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:54.838210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 100/186] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:40:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:54.841953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a440998-5d37-4afd-ad16-e5c178a27167 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:54.871023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 87/187] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:40:54.873790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257223-1fa5-48de-a447-1fdf79c6537f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:55.012856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a440998-5d37-4afd-ad16-e5c178a27167 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.045985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257223-1fa5-48de-a447-1fdf79c6537f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.055243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c685-411d-466a-8178-1fda020cc29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.056410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c685-411d-466a-8178-1fda020cc29d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.056888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c685-411d-466a-8178-1fda020cc29d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.060055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c685-411d-466a-8178-1fda020cc29d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.070324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c685-411d-466a-8178-1fda020cc29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-d246c685-411d-466a-8178-1fda020cc29d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:55.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:55.079356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 101/188] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:55.080263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c685-411d-466a-8178-1fda020cc29d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:55.088307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dc41d-b91c-47d3-ad84-82da0c34af60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.088984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dc41d-b91c-47d3-ad84-82da0c34af60 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.089292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dc41d-b91c-47d3-ad84-82da0c34af60 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.089570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dc41d-b91c-47d3-ad84-82da0c34af60 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.090326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dc41d-b91c-47d3-ad84-82da0c34af60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:55.090628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dc41d-b91c-47d3-ad84-82da0c34af60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:55.092019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dc41d-b91c-47d3-ad84-82da0c34af60 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:55.101524 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 88/189] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:40:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:55.102808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e2a8-42e3-477f-8524-bc83b47d342b None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.103091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e2a8-42e3-477f-8524-bc83b47d342b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.103364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e2a8-42e3-477f-8524-bc83b47d342b None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.104946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 89/190] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:55.108994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e2a8-42e3-477f-8524-bc83b47d342b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:55.186057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c685-411d-466a-8178-1fda020cc29d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.210466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e2a8-42e3-477f-8524-bc83b47d342b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.219099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85014b03-689d-49a3-aa18-d6f0c3178292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.219998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85014b03-689d-49a3-aa18-d6f0c3178292 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.220346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85014b03-689d-49a3-aa18-d6f0c3178292 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.220708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85014b03-689d-49a3-aa18-d6f0c3178292 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.222049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85014b03-689d-49a3-aa18-d6f0c3178292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:55.224086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85014b03-689d-49a3-aa18-d6f0c3178292 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:55.225953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 102/191] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:55.226600 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85014b03-689d-49a3-aa18-d6f0c3178292 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:55.245634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc03b11-b268-4a91-926f-37c6ce276c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.246297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc03b11-b268-4a91-926f-37c6ce276c98 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.246579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc03b11-b268-4a91-926f-37c6ce276c98 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.246856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc03b11-b268-4a91-926f-37c6ce276c98 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.247610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc03b11-b268-4a91-926f-37c6ce276c98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:55.247921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc03b11-b268-4a91-926f-37c6ce276c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:55.249338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc03b11-b268-4a91-926f-37c6ce276c98 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:55.257882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 90/192] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:55.259179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcc12-ad08-46e5-bd6a-ef5c228cd10a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.259469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcc12-ad08-46e5-bd6a-ef5c228cd10a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.259750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fcc12-ad08-46e5-bd6a-ef5c228cd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.276018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-611fcc12-ad08-46e5-bd6a-ef5c228cd10a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:55.277344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-611fcc12-ad08-46e5-bd6a-ef5c228cd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:55.329339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85014b03-689d-49a3-aa18-d6f0c3178292 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.344040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 91/193] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:55.344697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcc12-ad08-46e5-bd6a-ef5c228cd10a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:55.364844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0179bc-3619-42be-9cf6-0a01bed7ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.365793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0179bc-3619-42be-9cf6-0a01bed7ef1b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.366079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0179bc-3619-42be-9cf6-0a01bed7ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.366368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0179bc-3619-42be-9cf6-0a01bed7ef1b None admin] PATH_INFO: `/v3/users/e807b614895e42da884300e2171de270` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.379867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0179bc-3619-42be-9cf6-0a01bed7ef1b None admin] RBAC: Authorizing `identity:get_user(user_id=e807b614895e42da884300e2171de270)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:55.381372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0179bc-3619-42be-9cf6-0a01bed7ef1b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:55.383069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 103/194] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:55 2022] GET /identity/v3/users/e807b614895e42da884300e2171de270 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:55.383866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0179bc-3619-42be-9cf6-0a01bed7ef1b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:55.450126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fcc12-ad08-46e5-bd6a-ef5c228cd10a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.501421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840266f4-256a-4d60-a7bb-9633dd9dba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.502487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840266f4-256a-4d60-a7bb-9633dd9dba63 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.502958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840266f4-256a-4d60-a7bb-9633dd9dba63 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.503419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840266f4-256a-4d60-a7bb-9633dd9dba63 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.504741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840266f4-256a-4d60-a7bb-9633dd9dba63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:55.507201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840266f4-256a-4d60-a7bb-9633dd9dba63 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:55.509126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0179bc-3619-42be-9cf6-0a01bed7ef1b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.547722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789e50-897b-4d98-8ce0-8f2fc2b40d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.548637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789e50-897b-4d98-8ce0-8f2fc2b40d2f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.548918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789e50-897b-4d98-8ce0-8f2fc2b40d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.549303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789e50-897b-4d98-8ce0-8f2fc2b40d2f None admin] PATH_INFO: `/v3/users/e807b614895e42da884300e2171de270` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.550559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63789e50-897b-4d98-8ce0-8f2fc2b40d2f None admin] RBAC: Authorizing `identity:get_user(user_id=e807b614895e42da884300e2171de270)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:55.552037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63789e50-897b-4d98-8ce0-8f2fc2b40d2f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:55.553765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 104/195] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:55 2022] GET /identity/v3/users/e807b614895e42da884300e2171de270 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:55.554515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789e50-897b-4d98-8ce0-8f2fc2b40d2f None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:55.650554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789e50-897b-4d98-8ce0-8f2fc2b40d2f None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.683086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e4ff4-0e68-4a9d-9831-4e758659d2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.683887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e4ff4-0e68-4a9d-9831-4e758659d2c6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.684161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e4ff4-0e68-4a9d-9831-4e758659d2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.684433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e4ff4-0e68-4a9d-9831-4e758659d2c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.695182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e4ff4-0e68-4a9d-9831-4e758659d2c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-175e4ff4-0e68-4a9d-9831-4e758659d2c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:55.702805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:55.703925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 105/196] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:55.704793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e4ff4-0e68-4a9d-9831-4e758659d2c6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:55.805107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e4ff4-0e68-4a9d-9831-4e758659d2c6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:55.837223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599183c5-166a-4b4a-947e-3da04c301fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:55.837904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599183c5-166a-4b4a-947e-3da04c301fbf None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:55.838187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599183c5-166a-4b4a-947e-3da04c301fbf None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:55.838461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599183c5-166a-4b4a-947e-3da04c301fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:55.907047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599183c5-166a-4b4a-947e-3da04c301fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:55.908651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599183c5-166a-4b4a-947e-3da04c301fbf None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:55.951017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 92/197] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:40:55 2022] POST /identity/v3/users => generated 297 bytes in 607 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:55.951889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840266f4-256a-4d60-a7bb-9633dd9dba63 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.053970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 106/198] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:56.055521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599183c5-166a-4b4a-947e-3da04c301fbf None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.096192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840266f4-256a-4d60-a7bb-9633dd9dba63 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:56.138707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583fc20-ba3e-421d-b758-87fe2fadec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:56.139098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583fc20-ba3e-421d-b758-87fe2fadec3e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.139378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583fc20-ba3e-421d-b758-87fe2fadec3e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.139648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583fc20-ba3e-421d-b758-87fe2fadec3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.176741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599183c5-166a-4b4a-947e-3da04c301fbf None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:56.227091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:56.227780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.228060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.228330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.229105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] RBAC: Adding query filter params (name=reader) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:56.229720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:56.231168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:56.235587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583fc20-ba3e-421d-b758-87fe2fadec3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:56.237099 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583fc20-ba3e-421d-b758-87fe2fadec3e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:56.242524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 107/199] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:56.243512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.376872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 93/200] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:56.378272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583fc20-ba3e-421d-b758-87fe2fadec3e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.380471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3014c0-bd81-4517-a7e5-fe0458830efd None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:56.419330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb372-4d5d-458b-bb0c-7986212521e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:56.420268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb372-4d5d-458b-bb0c-7986212521e8 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.420550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb372-4d5d-458b-bb0c-7986212521e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.420825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffb372-4d5d-458b-bb0c-7986212521e8 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.422146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffb372-4d5d-458b-bb0c-7986212521e8 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:56.423810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffb372-4d5d-458b-bb0c-7986212521e8 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:56.426027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 108/201] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:56 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:56.427422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb372-4d5d-458b-bb0c-7986212521e8 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.507703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583fc20-ba3e-421d-b758-87fe2fadec3e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:56.554514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a07020-b44d-4917-a05d-489fb1eae3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:56.554742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffb372-4d5d-458b-bb0c-7986212521e8 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:56.555411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07020-b44d-4917-a05d-489fb1eae3ee None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.555693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07020-b44d-4917-a05d-489fb1eae3ee None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.555968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07020-b44d-4917-a05d-489fb1eae3ee None admin] PATH_INFO: `/v3/users/0163c4ddcb794e8c9370a33b56eb5526` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.558280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a07020-b44d-4917-a05d-489fb1eae3ee None admin] RBAC: Authorizing `identity:get_user(user_id=0163c4ddcb794e8c9370a33b56eb5526)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:56.559759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a07020-b44d-4917-a05d-489fb1eae3ee None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:56.561468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 94/202] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:56 2022] GET /identity/v3/users/0163c4ddcb794e8c9370a33b56eb5526 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:56.563207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a07020-b44d-4917-a05d-489fb1eae3ee None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.593331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372599e-802d-43b1-999f-9f27095b14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:56.594294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372599e-802d-43b1-999f-9f27095b14dd None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.594762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372599e-802d-43b1-999f-9f27095b14dd None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.595125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372599e-802d-43b1-999f-9f27095b14dd None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.596496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372599e-802d-43b1-999f-9f27095b14dd None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:56.598603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372599e-802d-43b1-999f-9f27095b14dd None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:56.600528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 109/203] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:56 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:56.601293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372599e-802d-43b1-999f-9f27095b14dd None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.689731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a07020-b44d-4917-a05d-489fb1eae3ee None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:56.721638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372599e-802d-43b1-999f-9f27095b14dd None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:56.752087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:56.753186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.753864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.754455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.756041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] RBAC: Adding query filter params (role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=66345118156e4a658492e8c39ca0f753, user.id=e807b614895e42da884300e2171de270) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:56.756616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:56.758506 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:56.764756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 95/204] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:56 2022] GET /identity/v3/role_assignments?user.id=e807b614895e42da884300e2171de270&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:56.766026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.779667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf43f15-9139-402e-a591-4534189a4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:56.784264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43f15-9139-402e-a591-4534189a4f6a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.784619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43f15-9139-402e-a591-4534189a4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.784904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43f15-9139-402e-a591-4534189a4f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.909317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf43f15-9139-402e-a591-4534189a4f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:56.911744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf43f15-9139-402e-a591-4534189a4f6a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:56.978130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23568142-07e3-444a-acf8-c4d172c0d36d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:57.013812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:57.014482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:57.014759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:57.015029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:57.015879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=66345118156e4a658492e8c39ca0f753, user.id=e807b614895e42da884300e2171de270) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:57.016187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:57.017873 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:57.024863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 96/205] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:56 2022] GET /identity/v3/role_assignments?user.id=e807b614895e42da884300e2171de270&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=f1d6bdc882c24a2a9389961135865317 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:57.096732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 110/206] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:40:57.103387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:57.249586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d30da-3759-4f6c-9e32-e4dcf0e55d58 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:57.286708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f84df3-56a5-4cd3-b662-d91fa8f81775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:57.288049 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84df3-56a5-4cd3-b662-d91fa8f81775 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:57.288557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84df3-56a5-4cd3-b662-d91fa8f81775 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:57.288858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84df3-56a5-4cd3-b662-d91fa8f81775 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:57.290351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f84df3-56a5-4cd3-b662-d91fa8f81775 None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:57.291837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f84df3-56a5-4cd3-b662-d91fa8f81775 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:57.293911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 97/207] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:57 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:57.300262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf43f15-9139-402e-a591-4534189a4f6a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:57.440635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf43f15-9139-402e-a591-4534189a4f6a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:57.495071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be2b97-db00-488e-8a8b-a989ab8cea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:57.495745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be2b97-db00-488e-8a8b-a989ab8cea20 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:57.496024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be2b97-db00-488e-8a8b-a989ab8cea20 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:57.496296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be2b97-db00-488e-8a8b-a989ab8cea20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:57.497145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be2b97-db00-488e-8a8b-a989ab8cea20 None admin] RBAC: Adding query filter params (role.id=f0fe679843d746969573ffe11d85ee3b, scope.project.id=a115aa26e75244d4a57940a1d2497960, user.id=0163c4ddcb794e8c9370a33b56eb5526) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:57.497477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be2b97-db00-488e-8a8b-a989ab8cea20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:57.498915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be2b97-db00-488e-8a8b-a989ab8cea20 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:57.510521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 111/208] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:40:57 2022] GET /identity/v3/role_assignments?user.id=0163c4ddcb794e8c9370a33b56eb5526&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=f0fe679843d746969573ffe11d85ee3b => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:58.734013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225a91-c665-4fbc-b087-9d9bff28f3e3 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:58.734531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225a91-c665-4fbc-b087-9d9bff28f3e3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:58.734635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225a91-c665-4fbc-b087-9d9bff28f3e3 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:58.735964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 98/209] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:58.741770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f17486-0056-405f-8a42-cae978ec411c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:58.742246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f17486-0056-405f-8a42-cae978ec411c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:58.742322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f17486-0056-405f-8a42-cae978ec411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:58.760348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-18f17486-0056-405f-8a42-cae978ec411c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:58.761575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-18f17486-0056-405f-8a42-cae978ec411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:58.837363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 112/210] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:58.857444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6225a91-c665-4fbc-b087-9d9bff28f3e3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:58.867043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c969-fd6f-4dc3-b7df-cd1e3b7a8e8b None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:58.867368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c969-fd6f-4dc3-b7df-cd1e3b7a8e8b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:58.867648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c969-fd6f-4dc3-b7df-cd1e3b7a8e8b None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:58.870346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 113/211] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:58.877139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4758-caab-46d7-88f6-93d308f4807c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:58.877671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4758-caab-46d7-88f6-93d308f4807c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:58.878107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4758-caab-46d7-88f6-93d308f4807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:58.900445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-323f4758-caab-46d7-88f6-93d308f4807c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:58.901661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-323f4758-caab-46d7-88f6-93d308f4807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:58.983467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 114/212] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:40:58.986098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6225a91-c665-4fbc-b087-9d9bff28f3e3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:59.009633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4758-caab-46d7-88f6-93d308f4807c None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:59.025877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40318eb-b0d1-4c5c-8676-724f05deadee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:59.026843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40318eb-b0d1-4c5c-8676-724f05deadee None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.027130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40318eb-b0d1-4c5c-8676-724f05deadee None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.027697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40318eb-b0d1-4c5c-8676-724f05deadee None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.042323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40318eb-b0d1-4c5c-8676-724f05deadee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-d40318eb-b0d1-4c5c-8676-724f05deadee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:59.052087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:59.054159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:40:59.055932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:40:59.057333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 99/213] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:40:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:59.061284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40318eb-b0d1-4c5c-8676-724f05deadee None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:59.120514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4758-caab-46d7-88f6-93d308f4807c None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:59.158329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ef7fa-eb7b-4778-9fbd-41a78e57c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:59.159564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef7fa-eb7b-4778-9fbd-41a78e57c4fa None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.160069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef7fa-eb7b-4778-9fbd-41a78e57c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.160636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef7fa-eb7b-4778-9fbd-41a78e57c4fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.162249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ef7fa-eb7b-4778-9fbd-41a78e57c4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:59.164034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ef7fa-eb7b-4778-9fbd-41a78e57c4fa None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:59.170710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40318eb-b0d1-4c5c-8676-724f05deadee None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:59.171238 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 115/214] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:40:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:59.172461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ef7fa-eb7b-4778-9fbd-41a78e57c4fa None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:59.205138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:59.205861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.205969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.206235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.207226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] RBAC: Adding query filter params (name=member) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:40:59.208028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:59.209546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:59.223163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 100/215] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:40:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:40:59.224956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:59.281140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ef7fa-eb7b-4778-9fbd-41a78e57c4fa None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:59.319990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85838706-1e0a-40ac-b0e0-662a4cb5abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:59.321199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838706-1e0a-40ac-b0e0-662a4cb5abb2 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.321744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838706-1e0a-40ac-b0e0-662a4cb5abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.322209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838706-1e0a-40ac-b0e0-662a4cb5abb2 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.323174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85838706-1e0a-40ac-b0e0-662a4cb5abb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:59.325637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85838706-1e0a-40ac-b0e0-662a4cb5abb2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:59.341485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99c524-9ed2-4516-bb46-cdda12747b53 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:59.378588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717dc67-1564-4513-82ea-34f1f87dd25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:59.379994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717dc67-1564-4513-82ea-34f1f87dd25b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.380272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717dc67-1564-4513-82ea-34f1f87dd25b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.380548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717dc67-1564-4513-82ea-34f1f87dd25b None admin] PATH_INFO: `/v3/users/c72036cc4d2c4ebd99a8e883ad37e73a` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.395833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717dc67-1564-4513-82ea-34f1f87dd25b None admin] RBAC: Authorizing `identity:get_user(user_id=c72036cc4d2c4ebd99a8e883ad37e73a)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:59.397362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717dc67-1564-4513-82ea-34f1f87dd25b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:59.399130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 101/216] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:40:59 2022] GET /identity/v3/users/c72036cc4d2c4ebd99a8e883ad37e73a => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:40:59.400420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382d84a-db80-42dc-94cc-c34419c3d2b9 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.400711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382d84a-db80-42dc-94cc-c34419c3d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.400990 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382d84a-db80-42dc-94cc-c34419c3d2b9 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.404413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 102/217] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:59.405262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382d84a-db80-42dc-94cc-c34419c3d2b9 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:59.461281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 116/218] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:40:59 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:40:59.461281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987568e-28ca-454b-b9b8-d03ce2091883 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.461281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987568e-28ca-454b-b9b8-d03ce2091883 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.461281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987568e-28ca-454b-b9b8-d03ce2091883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.480661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d987568e-28ca-454b-b9b8-d03ce2091883 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:59.481964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d987568e-28ca-454b-b9b8-d03ce2091883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:59.576817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 117/219] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:40:59.586091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382d84a-db80-42dc-94cc-c34419c3d2b9 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:59.617732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987568e-28ca-454b-b9b8-d03ce2091883 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:59.629638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135d72-5d0f-41d0-8dea-55ee33e8dd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:59.630474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135d72-5d0f-41d0-8dea-55ee33e8dd0c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.630763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135d72-5d0f-41d0-8dea-55ee33e8dd0c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.631042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135d72-5d0f-41d0-8dea-55ee33e8dd0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.728184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5135d72-5d0f-41d0-8dea-55ee33e8dd0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:59.730089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5135d72-5d0f-41d0-8dea-55ee33e8dd0c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:59.781979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987568e-28ca-454b-b9b8-d03ce2091883 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:59.837274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557925ee-8797-4595-995a-41462bd7fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:59.837274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557925ee-8797-4595-995a-41462bd7fba6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.837274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557925ee-8797-4595-995a-41462bd7fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.837274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557925ee-8797-4595-995a-41462bd7fba6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.849131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 103/220] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:40:59.850527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee73a5-4f44-43aa-91aa-4bab36998ff1 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.850811 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee73a5-4f44-43aa-91aa-4bab36998ff1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.851089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee73a5-4f44-43aa-91aa-4bab36998ff1 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.852375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 104/221] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:59.855633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557925ee-8797-4595-995a-41462bd7fba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:40:59.858150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee73a5-4f44-43aa-91aa-4bab36998ff1 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-557925ee-8797-4595-995a-41462bd7fba6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:40:59.866666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:40:59.867887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:40:59.868949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:40:59.872219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 118/222] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:40:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:40:59.876325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28351437-28d2-4c60-8516-832a74d2ea6b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:59.876325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28351437-28d2-4c60-8516-832a74d2ea6b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:59.876325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28351437-28d2-4c60-8516-832a74d2ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:59.905483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-28351437-28d2-4c60-8516-832a74d2ea6b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:59.906686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-28351437-28d2-4c60-8516-832a74d2ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:59.983845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee73a5-4f44-43aa-91aa-4bab36998ff1 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:00.008692 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 119/223] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:00.013718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28351437-28d2-4c60-8516-832a74d2ea6b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:00.026180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21d6a4-f31e-4ed4-a95f-3433cd934c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:00.027064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21d6a4-f31e-4ed4-a95f-3433cd934c90 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.027343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21d6a4-f31e-4ed4-a95f-3433cd934c90 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.028116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21d6a4-f31e-4ed4-a95f-3433cd934c90 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.029400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21d6a4-f31e-4ed4-a95f-3433cd934c90 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:00.030860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21d6a4-f31e-4ed4-a95f-3433cd934c90 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:00.032607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 105/224] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:40:59 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:00.039239 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21d6a4-f31e-4ed4-a95f-3433cd934c90 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:00.146921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28351437-28d2-4c60-8516-832a74d2ea6b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:00.163957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21d6a4-f31e-4ed4-a95f-3433cd934c90 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:00.189582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:00.190527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.190814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.191095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.192963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:00.193320 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:00.195075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:00.200816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:00.201765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.202191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.202539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.203453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] RBAC: Adding query filter params (role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=66345118156e4a658492e8c39ca0f753, user.id=c72036cc4d2c4ebd99a8e883ad37e73a) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:00.203833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:00.205361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 120/225] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:00.205568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:00.206209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:00.215615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 106/226] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:00 2022] GET /identity/v3/role_assignments?user.id=c72036cc4d2c4ebd99a8e883ad37e73a&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=68f91fa718f44020a307be6b2f10b834 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:00.216722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:00.342913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ea3a2-b4bf-4003-8e10-ad9fef2b42b7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:00.361086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91071325-f17e-4269-9d6c-813de2414bb5 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:00.384103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d821e-98cf-46e9-9b2e-c67ecfa60964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:00.385120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d821e-98cf-46e9-9b2e-c67ecfa60964 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.385538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d821e-98cf-46e9-9b2e-c67ecfa60964 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.385884 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d821e-98cf-46e9-9b2e-c67ecfa60964 None admin] PATH_INFO: `/v3/users/e807b614895e42da884300e2171de270` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.387376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d821e-98cf-46e9-9b2e-c67ecfa60964 None admin] RBAC: Authorizing `identity:get_user(user_id=e807b614895e42da884300e2171de270)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:00.388987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d821e-98cf-46e9-9b2e-c67ecfa60964 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:00.390905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 107/227] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:00 2022] GET /identity/v3/users/e807b614895e42da884300e2171de270 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:00.397680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d821e-98cf-46e9-9b2e-c67ecfa60964 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:00.422363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a5fc8-184a-4aa5-b769-3debe85a5272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:00.423920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5fc8-184a-4aa5-b769-3debe85a5272 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.424634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5fc8-184a-4aa5-b769-3debe85a5272 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.425361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5fc8-184a-4aa5-b769-3debe85a5272 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.443018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a5fc8-184a-4aa5-b769-3debe85a5272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-849a5fc8-184a-4aa5-b769-3debe85a5272 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:00.457185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:00.459420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:00.460921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:00.465579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 121/228] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:00.475990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a5fc8-184a-4aa5-b769-3debe85a5272 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:00.557533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d821e-98cf-46e9-9b2e-c67ecfa60964 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:00.601038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52248ab1-2ca0-425d-9d5d-7a372b1c10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:00.601948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248ab1-2ca0-425d-9d5d-7a372b1c10fd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.602226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248ab1-2ca0-425d-9d5d-7a372b1c10fd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.602552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248ab1-2ca0-425d-9d5d-7a372b1c10fd None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.603774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52248ab1-2ca0-425d-9d5d-7a372b1c10fd None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:00.606481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52248ab1-2ca0-425d-9d5d-7a372b1c10fd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:00.617319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 108/229] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:00 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:00.621357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52248ab1-2ca0-425d-9d5d-7a372b1c10fd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:00.713120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a5fc8-184a-4aa5-b769-3debe85a5272 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:00.777512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:00.778232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.778514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.778787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.779599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:00.779908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:00.781342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:00.799848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 122/230] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:00.807733 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:00.825087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52248ab1-2ca0-425d-9d5d-7a372b1c10fd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:00.907741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620367c-30c7-43ef-9516-bb6d4c760fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:00.908657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620367c-30c7-43ef-9516-bb6d4c760fba None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.908942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620367c-30c7-43ef-9516-bb6d4c760fba None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.909223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620367c-30c7-43ef-9516-bb6d4c760fba None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753/users/e807b614895e42da884300e2171de270/roles/597c56383ca9464ca3bf4ae47dbf7716` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.916359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620367c-30c7-43ef-9516-bb6d4c760fba None admin] RBAC: Authorizing `identity:create_grant(project_id=66345118156e4a658492e8c39ca0f753, user_id=e807b614895e42da884300e2171de270, role_id=597c56383ca9464ca3bf4ae47dbf7716)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:00.917902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620367c-30c7-43ef-9516-bb6d4c760fba None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:00.983071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 109/231] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:00 2022] PUT /identity/v3/projects/66345118156e4a658492e8c39ca0f753/users/e807b614895e42da884300e2171de270/roles/597c56383ca9464ca3bf4ae47dbf7716 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:41:01.015420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1a26b-1772-4a60-9d1c-15f0de3b0a9a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:01.083077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ab960-0b14-4a85-b179-d39ea65ee1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:01.084415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ab960-0b14-4a85-b179-d39ea65ee1c7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:01.084910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ab960-0b14-4a85-b179-d39ea65ee1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:01.085427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ab960-0b14-4a85-b179-d39ea65ee1c7 None admin] PATH_INFO: `/v3/users/e807b614895e42da884300e2171de270` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:01.087078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ab960-0b14-4a85-b179-d39ea65ee1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=e807b614895e42da884300e2171de270)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:01.088762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ab960-0b14-4a85-b179-d39ea65ee1c7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:01.090732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 123/232] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:00 2022] GET /identity/v3/users/e807b614895e42da884300e2171de270 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:01.098776 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620367c-30c7-43ef-9516-bb6d4c760fba None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:01.276805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620367c-30c7-43ef-9516-bb6d4c760fba None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:01.330962 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51722cc7-e17c-42b1-9f2e-eb432ac0b479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:01.332847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722cc7-e17c-42b1-9f2e-eb432ac0b479 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:01.333323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722cc7-e17c-42b1-9f2e-eb432ac0b479 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:01.333774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51722cc7-e17c-42b1-9f2e-eb432ac0b479 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:01.335910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722cc7-e17c-42b1-9f2e-eb432ac0b479 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:01.338662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51722cc7-e17c-42b1-9f2e-eb432ac0b479 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:01.341894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 110/233] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:01 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:01.348355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ab960-0b14-4a85-b179-d39ea65ee1c7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:01.493324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ab960-0b14-4a85-b179-d39ea65ee1c7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:01.543524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f6862-d9e1-460d-9a13-fb320155b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:01.544400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6862-d9e1-460d-9a13-fb320155b634 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:01.544678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6862-d9e1-460d-9a13-fb320155b634 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:01.544952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6862-d9e1-460d-9a13-fb320155b634 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753/users/e807b614895e42da884300e2171de270/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:01.547024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f6862-d9e1-460d-9a13-fb320155b634 None admin] RBAC: Authorizing `identity:create_grant(project_id=66345118156e4a658492e8c39ca0f753, user_id=e807b614895e42da884300e2171de270, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:01.548474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f6862-d9e1-460d-9a13-fb320155b634 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:01.631727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 124/234] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:01 2022] PUT /identity/v3/projects/66345118156e4a658492e8c39ca0f753/users/e807b614895e42da884300e2171de270/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:41:02.465927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d970e-e8ad-405e-acc1-0480730b971b None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:02.466708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d970e-e8ad-405e-acc1-0480730b971b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:02.466708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d970e-e8ad-405e-acc1-0480730b971b None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:02.468167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 111/235] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:02.473993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622731a-f1ed-43ab-8395-4f2a7ed2b792 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:02.474758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622731a-f1ed-43ab-8395-4f2a7ed2b792 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:02.474758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622731a-f1ed-43ab-8395-4f2a7ed2b792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:02.496215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d622731a-f1ed-43ab-8395-4f2a7ed2b792 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:02.497441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d622731a-f1ed-43ab-8395-4f2a7ed2b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:02.584754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 125/236] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:02.628715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d970e-e8ad-405e-acc1-0480730b971b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:02.728260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96a81d-037d-4886-990b-782d7b995ff1 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:02.728834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96a81d-037d-4886-990b-782d7b995ff1 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:02.729741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96a81d-037d-4886-990b-782d7b995ff1 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:02.733202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 126/237] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:02.737920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531099-8bf0-4124-a418-5e56e627d713 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:02.738214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531099-8bf0-4124-a418-5e56e627d713 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:02.738495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531099-8bf0-4124-a418-5e56e627d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:02.787944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0d531099-8bf0-4124-a418-5e56e627d713 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:02.789871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0d531099-8bf0-4124-a418-5e56e627d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:02.791222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d970e-e8ad-405e-acc1-0480730b971b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:02.828451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696175c2-5664-4480-8fef-6dc97774fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:02.829661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696175c2-5664-4480-8fef-6dc97774fd06 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:02.830148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696175c2-5664-4480-8fef-6dc97774fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:02.830660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696175c2-5664-4480-8fef-6dc97774fd06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:02.842397 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696175c2-5664-4480-8fef-6dc97774fd06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-696175c2-5664-4480-8fef-6dc97774fd06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:02.850957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:02.851911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:02.852699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:02.857129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 112/238] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:02.863066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696175c2-5664-4480-8fef-6dc97774fd06 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:02.976427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696175c2-5664-4480-8fef-6dc97774fd06 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:02.987888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 127/239] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:03.015539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:03.016597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.017131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.017628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.018626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:03.019138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:03.021509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:03.031372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 113/240] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:03.033131 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531099-8bf0-4124-a418-5e56e627d713 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:03.036997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:03.194795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4678ab-31bd-4ab0-b91d-8c35619be3fc None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:03.230951 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31da6-6fae-4c67-b2a2-a326d81f1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:03.232267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31da6-6fae-4c67-b2a2-a326d81f1b2b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.232749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31da6-6fae-4c67-b2a2-a326d81f1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.233223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31da6-6fae-4c67-b2a2-a326d81f1b2b None admin] PATH_INFO: `/v3/users/3de1a94ee64e4cd3a4418b4ee70f8c86` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.244561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d531099-8bf0-4124-a418-5e56e627d713 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:03.248624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e31da6-6fae-4c67-b2a2-a326d81f1b2b None admin] RBAC: Authorizing `identity:get_user(user_id=3de1a94ee64e4cd3a4418b4ee70f8c86)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:03.250417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e31da6-6fae-4c67-b2a2-a326d81f1b2b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:03.252872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 114/241] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:03 2022] GET /identity/v3/users/3de1a94ee64e4cd3a4418b4ee70f8c86 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:03.260856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31da6-6fae-4c67-b2a2-a326d81f1b2b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:03.290433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3babb-3bb6-4331-9731-38e8e142e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:03.291267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3babb-3bb6-4331-9731-38e8e142e754 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.291541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3babb-3bb6-4331-9731-38e8e142e754 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.291822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3babb-3bb6-4331-9731-38e8e142e754 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.295270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3babb-3bb6-4331-9731-38e8e142e754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:03.297522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3babb-3bb6-4331-9731-38e8e142e754 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:03.300369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 128/242] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:03.302003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14488da4-a1a0-48ff-8c49-004e37cf2047 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.302599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14488da4-a1a0-48ff-8c49-004e37cf2047 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.302881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14488da4-a1a0-48ff-8c49-004e37cf2047 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.309426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 129/243] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:03.311214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14488da4-a1a0-48ff-8c49-004e37cf2047 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:03.410321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31da6-6fae-4c67-b2a2-a326d81f1b2b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:03.427764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14488da4-a1a0-48ff-8c49-004e37cf2047 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:03.455483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad666-f354-48b9-a39d-29881b4c9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:03.456936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad666-f354-48b9-a39d-29881b4c9ecf None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.457597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad666-f354-48b9-a39d-29881b4c9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.458277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad666-f354-48b9-a39d-29881b4c9ecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.466136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddd724-d999-4516-bcc3-2c8c3880c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:03.467252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd724-d999-4516-bcc3-2c8c3880c791 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.467717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd724-d999-4516-bcc3-2c8c3880c791 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.468168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddd724-d999-4516-bcc3-2c8c3880c791 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.469123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddd724-d999-4516-bcc3-2c8c3880c791 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:03.470865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddd724-d999-4516-bcc3-2c8c3880c791 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:03.540492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad666-f354-48b9-a39d-29881b4c9ecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:03.542011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad666-f354-48b9-a39d-29881b4c9ecf None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:03.613463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 130/244] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:41:03 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:03.621990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910672b-af35-4425-9118-a956128a3336 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.621990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910672b-af35-4425-9118-a956128a3336 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.621990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910672b-af35-4425-9118-a956128a3336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.657466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3910672b-af35-4425-9118-a956128a3336 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:03.659024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3910672b-af35-4425-9118-a956128a3336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:03.716544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 115/245] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:03.722311 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad666-f354-48b9-a39d-29881b4c9ecf None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:03.792712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 131/246] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:03.838135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910672b-af35-4425-9118-a956128a3336 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:03.897091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad666-f354-48b9-a39d-29881b4c9ecf None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:03.936579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625ae29-27fe-48ff-86a7-2c836f5c5f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:03.937327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ae29-27fe-48ff-86a7-2c836f5c5f70 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.937654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ae29-27fe-48ff-86a7-2c836f5c5f70 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.938223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ae29-27fe-48ff-86a7-2c836f5c5f70 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.939416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625ae29-27fe-48ff-86a7-2c836f5c5f70 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:03.941433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625ae29-27fe-48ff-86a7-2c836f5c5f70 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:03.943326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 116/247] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:03 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:03.954293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625ae29-27fe-48ff-86a7-2c836f5c5f70 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:03.979779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910672b-af35-4425-9118-a956128a3336 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.051751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49515-2aed-4a10-94ec-e1247b1a44f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.052456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49515-2aed-4a10-94ec-e1247b1a44f3 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.052744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49515-2aed-4a10-94ec-e1247b1a44f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.053018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49515-2aed-4a10-94ec-e1247b1a44f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.065138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa49515-2aed-4a10-94ec-e1247b1a44f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-baa49515-2aed-4a10-94ec-e1247b1a44f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:04.076690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:04.077654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:04.078892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 132/248] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:04.084533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49515-2aed-4a10-94ec-e1247b1a44f3 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:04.086695 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625ae29-27fe-48ff-86a7-2c836f5c5f70 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.128745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d88b6-a149-4397-aac3-f5bf9b7ee4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.130156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d88b6-a149-4397-aac3-f5bf9b7ee4b5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.130916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d88b6-a149-4397-aac3-f5bf9b7ee4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.131201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d88b6-a149-4397-aac3-f5bf9b7ee4b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.132053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d88b6-a149-4397-aac3-f5bf9b7ee4b5 None admin] RBAC: Adding query filter params (role.id=f0fe679843d746969573ffe11d85ee3b, scope.project.id=66345118156e4a658492e8c39ca0f753, user.id=3de1a94ee64e4cd3a4418b4ee70f8c86) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:04.132363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d88b6-a149-4397-aac3-f5bf9b7ee4b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:04.134495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d88b6-a149-4397-aac3-f5bf9b7ee4b5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:04.145085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 117/249] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:03 2022] GET /identity/v3/role_assignments?user.id=3de1a94ee64e4cd3a4418b4ee70f8c86&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=f0fe679843d746969573ffe11d85ee3b => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:04.226968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5bce1-05c2-415f-ba5c-ef08045d7735 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.227288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5bce1-05c2-415f-ba5c-ef08045d7735 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.227564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5bce1-05c2-415f-ba5c-ef08045d7735 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.228990 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 118/250] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:04.234970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51122f-858b-497b-897e-91ea394c90c9 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.235270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51122f-858b-497b-897e-91ea394c90c9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.235536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51122f-858b-497b-897e-91ea394c90c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.255206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49515-2aed-4a10-94ec-e1247b1a44f3 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.259148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8f51122f-858b-497b-897e-91ea394c90c9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:04.260389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8f51122f-858b-497b-897e-91ea394c90c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:04.320183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.321177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.321751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.322196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.323834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:04.324349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:04.326632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:04.340165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 133/251] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:04.345648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:04.363358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 119/252] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:04.387893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51122f-858b-497b-897e-91ea394c90c9 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:04.494857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d95bcf-8421-43d5-9dba-0ddfb5c17627 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.531746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51122f-858b-497b-897e-91ea394c90c9 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.538386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8b4d-b19f-4f0e-9999-0b5086d00cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.539738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8b4d-b19f-4f0e-9999-0b5086d00cf6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.540243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8b4d-b19f-4f0e-9999-0b5086d00cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.540696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb8b4d-b19f-4f0e-9999-0b5086d00cf6 None admin] PATH_INFO: `/v3/users/c72036cc4d2c4ebd99a8e883ad37e73a` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.542955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb8b4d-b19f-4f0e-9999-0b5086d00cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=c72036cc4d2c4ebd99a8e883ad37e73a)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:04.544902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb8b4d-b19f-4f0e-9999-0b5086d00cf6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:04.547456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 134/253] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:04 2022] GET /identity/v3/users/c72036cc4d2c4ebd99a8e883ad37e73a => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:04.556000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8b4d-b19f-4f0e-9999-0b5086d00cf6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:04.578225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599c1f0-baef-4568-a50f-44e7e957c715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.579084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c1f0-baef-4568-a50f-44e7e957c715 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.579603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c1f0-baef-4568-a50f-44e7e957c715 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.580608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c1f0-baef-4568-a50f-44e7e957c715 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.602469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599c1f0-baef-4568-a50f-44e7e957c715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-7599c1f0-baef-4568-a50f-44e7e957c715 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:04.611552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:04.612851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:04.613753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 120/254] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:41:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:04.620460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599c1f0-baef-4568-a50f-44e7e957c715 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:04.687902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb8b4d-b19f-4f0e-9999-0b5086d00cf6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.738058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427d407-fcf2-4c9a-b2a5-6729cf1a904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.739413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d407-fcf2-4c9a-b2a5-6729cf1a904a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.739907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d407-fcf2-4c9a-b2a5-6729cf1a904a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.740403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d407-fcf2-4c9a-b2a5-6729cf1a904a None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.741972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427d407-fcf2-4c9a-b2a5-6729cf1a904a None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:04.743776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427d407-fcf2-4c9a-b2a5-6729cf1a904a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:04.745802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 135/255] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:04 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:04.751564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427d407-fcf2-4c9a-b2a5-6729cf1a904a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:04.783429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599c1f0-baef-4568-a50f-44e7e957c715 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.820676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.821396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.821680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.821954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.822726 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:04.823031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:04.824460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:04.834601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 121/256] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:04.842369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:04.897021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427d407-fcf2-4c9a-b2a5-6729cf1a904a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.930936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f09f2-c6e4-4c41-bd85-8d2d7daaf1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.931835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f09f2-c6e4-4c41-bd85-8d2d7daaf1f4 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.932120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f09f2-c6e4-4c41-bd85-8d2d7daaf1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.932397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f09f2-c6e4-4c41-bd85-8d2d7daaf1f4 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753/users/c72036cc4d2c4ebd99a8e883ad37e73a/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.934442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f09f2-c6e4-4c41-bd85-8d2d7daaf1f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=66345118156e4a658492e8c39ca0f753, user_id=c72036cc4d2c4ebd99a8e883ad37e73a, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:04.935897 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f09f2-c6e4-4c41-bd85-8d2d7daaf1f4 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:04.954344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dade8cd-29e5-4cb9-9373-69f7796673a9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:04.987972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccc4e9-5663-4f7a-bf68-5bea153eeba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:04.989489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccc4e9-5663-4f7a-bf68-5bea153eeba5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:04.989865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccc4e9-5663-4f7a-bf68-5bea153eeba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:04.991289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccc4e9-5663-4f7a-bf68-5bea153eeba5 None admin] PATH_INFO: `/v3/users/e807b614895e42da884300e2171de270` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:04.993793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccc4e9-5663-4f7a-bf68-5bea153eeba5 None admin] RBAC: Authorizing `identity:get_user(user_id=e807b614895e42da884300e2171de270)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:04.995291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccc4e9-5663-4f7a-bf68-5bea153eeba5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:04.996933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 122/257] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:04 2022] GET /identity/v3/users/e807b614895e42da884300e2171de270 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:05.002596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccc4e9-5663-4f7a-bf68-5bea153eeba5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:05.019609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 136/258] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:04 2022] PUT /identity/v3/projects/66345118156e4a658492e8c39ca0f753/users/c72036cc4d2c4ebd99a8e883ad37e73a/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:41:05.114111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccc4e9-5663-4f7a-bf68-5bea153eeba5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:05.130223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad24d-d4f1-492c-8ac2-c9a62ae7d2ce None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:05.130611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad24d-d4f1-492c-8ac2-c9a62ae7d2ce None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:05.130768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aad24d-d4f1-492c-8ac2-c9a62ae7d2ce None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:05.132283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 137/259] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:05.138122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12375c-a727-4ba5-abd8-3a0245a6dad6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:05.138412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12375c-a727-4ba5-abd8-3a0245a6dad6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:05.138697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12375c-a727-4ba5-abd8-3a0245a6dad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:05.152279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cefd7-0fc0-4311-8e78-dc0b282942fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:05.152957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cefd7-0fc0-4311-8e78-dc0b282942fb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:05.153324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cefd7-0fc0-4311-8e78-dc0b282942fb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:05.153606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cefd7-0fc0-4311-8e78-dc0b282942fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:05.174447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ee12375c-a727-4ba5-abd8-3a0245a6dad6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:05.175791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ee12375c-a727-4ba5-abd8-3a0245a6dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:05.230660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cefd7-0fc0-4311-8e78-dc0b282942fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:05.232272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cefd7-0fc0-4311-8e78-dc0b282942fb None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:05.300722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 138/260] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:05.325368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12375c-a727-4ba5-abd8-3a0245a6dad6 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:05.342018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 123/261] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:41:05.348693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cefd7-0fc0-4311-8e78-dc0b282942fb None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:05.464046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cefd7-0fc0-4311-8e78-dc0b282942fb None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:05.507821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f25cce-231f-4b11-835b-8a56c0156ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:05.508863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25cce-231f-4b11-835b-8a56c0156ccc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:05.509150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25cce-231f-4b11-835b-8a56c0156ccc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:05.509486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f25cce-231f-4b11-835b-8a56c0156ccc None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:05.511775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f25cce-231f-4b11-835b-8a56c0156ccc None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:05.513280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f25cce-231f-4b11-835b-8a56c0156ccc None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:05.515225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 124/262] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:05 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:05.522729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f25cce-231f-4b11-835b-8a56c0156ccc None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:05.549274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12375c-a727-4ba5-abd8-3a0245a6dad6 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:05.589861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501eb91-398d-43bd-814d-ae7aa1634d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:05.591146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eb91-398d-43bd-814d-ae7aa1634d40 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:05.591742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eb91-398d-43bd-814d-ae7aa1634d40 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:05.592213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eb91-398d-43bd-814d-ae7aa1634d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:05.606178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501eb91-398d-43bd-814d-ae7aa1634d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-4501eb91-398d-43bd-814d-ae7aa1634d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:05.615073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:05.616011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:05.616798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:05.619845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 139/263] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:05.630687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501eb91-398d-43bd-814d-ae7aa1634d40 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:05.652968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f25cce-231f-4b11-835b-8a56c0156ccc None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:05.695545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:05.696219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:05.696557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:05.696840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:05.698476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] RBAC: Adding query filter params (role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=66345118156e4a658492e8c39ca0f753, user.id=e807b614895e42da884300e2171de270) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:05.698916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:05.700551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:05.708428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 125/264] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:05 2022] GET /identity/v3/role_assignments?user.id=e807b614895e42da884300e2171de270&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:05.828292 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501eb91-398d-43bd-814d-ae7aa1634d40 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:05.870905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:05.871584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:05.871867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:05.872142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:05.872899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:05.873204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:05.874653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:05.885070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 140/265] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:05.893826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:06.019000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf55875-f169-4d19-ab0f-f058befcb592 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:06.069413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95781aa7-39f2-4f7a-9656-0c2084409978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:06.070310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95781aa7-39f2-4f7a-9656-0c2084409978 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:06.070598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95781aa7-39f2-4f7a-9656-0c2084409978 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:06.070877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95781aa7-39f2-4f7a-9656-0c2084409978 None admin] PATH_INFO: `/v3/users/e807b614895e42da884300e2171de270` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:06.078064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95781aa7-39f2-4f7a-9656-0c2084409978 None admin] RBAC: Authorizing `identity:get_user(user_id=e807b614895e42da884300e2171de270)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:06.079555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95781aa7-39f2-4f7a-9656-0c2084409978 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:06.081646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 126/266] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:05 2022] GET /identity/v3/users/e807b614895e42da884300e2171de270 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:06.088044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:06.265881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf489-9bc5-4c94-9b4c-3ef90a258e10 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:06.341826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f14de0-d968-4295-b41e-41398353efcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:06.343455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14de0-d968-4295-b41e-41398353efcd None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:06.344227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14de0-d968-4295-b41e-41398353efcd None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:06.345056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f14de0-d968-4295-b41e-41398353efcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:06.479836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f14de0-d968-4295-b41e-41398353efcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:06.483132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f14de0-d968-4295-b41e-41398353efcd None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:06.658091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 141/267] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:06.664885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95781aa7-39f2-4f7a-9656-0c2084409978 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:06.824693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95781aa7-39f2-4f7a-9656-0c2084409978 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:06.879782 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7fc8-e364-4785-8476-3f4cceb35b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:06.880712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7fc8-e364-4785-8476-3f4cceb35b49 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:06.880996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7fc8-e364-4785-8476-3f4cceb35b49 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:06.881292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7fc8-e364-4785-8476-3f4cceb35b49 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:06.882543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f7fc8-e364-4785-8476-3f4cceb35b49 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:06.884013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f7fc8-e364-4785-8476-3f4cceb35b49 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:06.886143 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 127/268] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:06 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:06.892035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f14de0-d968-4295-b41e-41398353efcd None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:07.046650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f14de0-d968-4295-b41e-41398353efcd None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:07.095380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a8c14-2d18-47ac-be73-b952dd794125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:07.096060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8c14-2d18-47ac-be73-b952dd794125 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.096344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8c14-2d18-47ac-be73-b952dd794125 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.096621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8c14-2d18-47ac-be73-b952dd794125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.097504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a8c14-2d18-47ac-be73-b952dd794125 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=66345118156e4a658492e8c39ca0f753, user.id=e807b614895e42da884300e2171de270) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:07.098504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a8c14-2d18-47ac-be73-b952dd794125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:07.099968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a8c14-2d18-47ac-be73-b952dd794125 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:07.109470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 142/269] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:06 2022] GET /identity/v3/role_assignments?user.id=e807b614895e42da884300e2171de270&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=f1d6bdc882c24a2a9389961135865317 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:07.514187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e379a2-aad7-42fe-a99c-928d566e49e0 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.514561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e379a2-aad7-42fe-a99c-928d566e49e0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.514756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e379a2-aad7-42fe-a99c-928d566e49e0 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.516478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 128/270] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:07.522809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba955-2bc4-470b-be51-868613c94574 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.523100 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba955-2bc4-470b-be51-868613c94574 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.523383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba955-2bc4-470b-be51-868613c94574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.542611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-dd2ba955-2bc4-470b-be51-868613c94574 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:07.543836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-dd2ba955-2bc4-470b-be51-868613c94574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:07.575607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46ea1-a934-4054-bd3d-b68a53443d1d None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.575899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46ea1-a934-4054-bd3d-b68a53443d1d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.576184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46ea1-a934-4054-bd3d-b68a53443d1d None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.577887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 129/271] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:07.584811 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b158c-d428-46ec-8c2c-8286de52b447 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.585102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b158c-d428-46ec-8c2c-8286de52b447 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.585427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b158c-d428-46ec-8c2c-8286de52b447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.608448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-2a9b158c-d428-46ec-8c2c-8286de52b447 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:07.609681 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2a9b158c-d428-46ec-8c2c-8286de52b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:07.643374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 143/272] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:07.670529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ba955-2bc4-470b-be51-868613c94574 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:07.721096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 130/273] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:07.748909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b158c-d428-46ec-8c2c-8286de52b447 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:07.789867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ba955-2bc4-470b-be51-868613c94574 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:07.826790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea1deb-8be9-4575-8306-f264e068d8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:07.827620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea1deb-8be9-4575-8306-f264e068d8cb None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.827898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea1deb-8be9-4575-8306-f264e068d8cb None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.828176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea1deb-8be9-4575-8306-f264e068d8cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.840360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea1deb-8be9-4575-8306-f264e068d8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b0ea1deb-8be9-4575-8306-f264e068d8cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:07.848885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:07.849882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:07.850676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:07.851885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 144/274] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:07.853518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d29382-22cd-4dd1-8309-af255830f23e None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.854032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d29382-22cd-4dd1-8309-af255830f23e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.854780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d29382-22cd-4dd1-8309-af255830f23e None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.856439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b158c-d428-46ec-8c2c-8286de52b447 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:07.856666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 145/275] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:07.858026 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d29382-22cd-4dd1-8309-af255830f23e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:07.898460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed5a3c-e94a-45b8-a24d-66ee5c9ca7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:07.899260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5a3c-e94a-45b8-a24d-66ee5c9ca7f7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.899541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5a3c-e94a-45b8-a24d-66ee5c9ca7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.899816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5a3c-e94a-45b8-a24d-66ee5c9ca7f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.912721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed5a3c-e94a-45b8-a24d-66ee5c9ca7f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-88ed5a3c-e94a-45b8-a24d-66ee5c9ca7f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:07.920605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:07.921685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:07.922488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:07.926708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 131/276] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:07.928097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d602-8d3e-463a-8b0e-a9df12679c52 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:07.928388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d602-8d3e-463a-8b0e-a9df12679c52 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:07.928669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d602-8d3e-463a-8b0e-a9df12679c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:07.945807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ac58d602-8d3e-463a-8b0e-a9df12679c52 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:07.947008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ac58d602-8d3e-463a-8b0e-a9df12679c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:07.967014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d29382-22cd-4dd1-8309-af255830f23e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.003556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.005074 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.005289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.005424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.006186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:08.006496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.007887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.016994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 146/277] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:08.024062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.026653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 132/278] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:08.033231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58d602-8d3e-463a-8b0e-a9df12679c52 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.145299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58d602-8d3e-463a-8b0e-a9df12679c52 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.146353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af774480-bd21-46fc-8662-91b278a094fe None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.185394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d356f-de5b-424e-be8d-ab52883ecb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.186293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d356f-de5b-424e-be8d-ab52883ecb0f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.186574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d356f-de5b-424e-be8d-ab52883ecb0f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.186847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d356f-de5b-424e-be8d-ab52883ecb0f None admin] PATH_INFO: `/v3/users/3de1a94ee64e4cd3a4418b4ee70f8c86` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.188208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d356f-de5b-424e-be8d-ab52883ecb0f None admin] RBAC: Authorizing `identity:get_user(user_id=3de1a94ee64e4cd3a4418b4ee70f8c86)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.189622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d356f-de5b-424e-be8d-ab52883ecb0f None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.191669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 133/279] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:08 2022] GET /identity/v3/users/3de1a94ee64e4cd3a4418b4ee70f8c86 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:08.193042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d356f-de5b-424e-be8d-ab52883ecb0f None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.195378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.197181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.197581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.197897 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.198711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:08.199032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.200515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.214449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 147/280] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:08.214449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.309363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d356f-de5b-424e-be8d-ab52883ecb0f None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.325357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1b46b-b8f4-4cae-881e-9a6d2bba78de None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.349709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119bd47-63b1-45e2-b5a4-8c8c1be73c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.350513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119bd47-63b1-45e2-b5a4-8c8c1be73c21 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.350840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119bd47-63b1-45e2-b5a4-8c8c1be73c21 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.351119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119bd47-63b1-45e2-b5a4-8c8c1be73c21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.352327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119bd47-63b1-45e2-b5a4-8c8c1be73c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.353862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119bd47-63b1-45e2-b5a4-8c8c1be73c21 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.355896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 134/281] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:08.356661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119bd47-63b1-45e2-b5a4-8c8c1be73c21 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.361944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a12301-4b88-49ae-8de9-e6ac371555bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.362806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12301-4b88-49ae-8de9-e6ac371555bf None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.363078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12301-4b88-49ae-8de9-e6ac371555bf None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.364264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12301-4b88-49ae-8de9-e6ac371555bf None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.365124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a12301-4b88-49ae-8de9-e6ac371555bf None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.366622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a12301-4b88-49ae-8de9-e6ac371555bf None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.368308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 148/282] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:08 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:08.369647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725b2d-8900-46bf-a5bc-d315e46dd0b2 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.369936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725b2d-8900-46bf-a5bc-d315e46dd0b2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.370211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac725b2d-8900-46bf-a5bc-d315e46dd0b2 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.371580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 149/283] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:08.374316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac725b2d-8900-46bf-a5bc-d315e46dd0b2 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.469486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119bd47-63b1-45e2-b5a4-8c8c1be73c21 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.483100 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac725b2d-8900-46bf-a5bc-d315e46dd0b2 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.503558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8012f-bd8f-467c-9ffd-097d68ccf7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.504481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8012f-bd8f-467c-9ffd-097d68ccf7c9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.504781 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8012f-bd8f-467c-9ffd-097d68ccf7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.505093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8012f-bd8f-467c-9ffd-097d68ccf7c9 None admin] PATH_INFO: `/v3/users/10c6e50becbe4674b2e5db8ed6d4db1c` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.516870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc9938-d165-40de-845b-81f4b2f586ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.517596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9938-d165-40de-845b-81f4b2f586ea None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.517877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9938-d165-40de-845b-81f4b2f586ea None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.518153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9938-d165-40de-845b-81f4b2f586ea None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.518876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc9938-d165-40de-845b-81f4b2f586ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.518979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8012f-bd8f-467c-9ffd-097d68ccf7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=10c6e50becbe4674b2e5db8ed6d4db1c)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.520390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc9938-d165-40de-845b-81f4b2f586ea None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.520814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8012f-bd8f-467c-9ffd-097d68ccf7c9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.522837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 135/284] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:08 2022] GET /identity/v3/users/10c6e50becbe4674b2e5db8ed6d4db1c => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:08.523390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8012f-bd8f-467c-9ffd-097d68ccf7c9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.626308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8012f-bd8f-467c-9ffd-097d68ccf7c9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.648520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 150/285] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:41:08 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:08.649891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ea30-fbd0-4a4e-81b3-78601ead1b66 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.650148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ea30-fbd0-4a4e-81b3-78601ead1b66 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.650426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ea30-fbd0-4a4e-81b3-78601ead1b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.663380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a908d-1c33-4bb8-9284-b3b3b28ba83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.664581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a908d-1c33-4bb8-9284-b3b3b28ba83c None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.664867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a908d-1c33-4bb8-9284-b3b3b28ba83c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.665142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a908d-1c33-4bb8-9284-b3b3b28ba83c None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753/users/3de1a94ee64e4cd3a4418b4ee70f8c86/roles/f0fe679843d746969573ffe11d85ee3b` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.667612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a908d-1c33-4bb8-9284-b3b3b28ba83c None admin] RBAC: Authorizing `identity:create_grant(project_id=66345118156e4a658492e8c39ca0f753, user_id=3de1a94ee64e4cd3a4418b4ee70f8c86, role_id=f0fe679843d746969573ffe11d85ee3b)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.669279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a908d-1c33-4bb8-9284-b3b3b28ba83c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.677450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b462ea30-fbd0-4a4e-81b3-78601ead1b66 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:08.678724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b462ea30-fbd0-4a4e-81b3-78601ead1b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:08.758149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 151/286] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:08.759112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462ea30-fbd0-4a4e-81b3-78601ead1b66 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.781576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 136/287] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:08 2022] PUT /identity/v3/projects/66345118156e4a658492e8c39ca0f753/users/3de1a94ee64e4cd3a4418b4ee70f8c86/roles/f0fe679843d746969573ffe11d85ee3b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:08.783204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a908d-1c33-4bb8-9284-b3b3b28ba83c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.896158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462ea30-fbd0-4a4e-81b3-78601ead1b66 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.946417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.947788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.948424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.949160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.950880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] RBAC: Adding query filter params (role.id=68f91fa718f44020a307be6b2f10b834, user.id=10c6e50becbe4674b2e5db8ed6d4db1c, scope.system=all) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:08.951574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.954147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.956485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a908d-1c33-4bb8-9284-b3b3b28ba83c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.966812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 152/288] 10.222.0.69 () {56 vars in 1308 bytes} [Wed May 4 13:41:08 2022] GET /identity/v3/role_assignments?user.id=10c6e50becbe4674b2e5db8ed6d4db1c&scope.system=all&role.id=68f91fa718f44020a307be6b2f10b834 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:08.998471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ceaaf-925c-42dd-8fbf-06165410e585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.999660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ceaaf-925c-42dd-8fbf-06165410e585 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.999939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ceaaf-925c-42dd-8fbf-06165410e585 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:09.000218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ceaaf-925c-42dd-8fbf-06165410e585 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:09.014314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ceaaf-925c-42dd-8fbf-06165410e585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-917ceaaf-925c-42dd-8fbf-06165410e585 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:09.023775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:09.025826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:09.027549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 137/289] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:09.031283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:09.164919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0893-9b48-4b50-b910-775be5ff9495 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:09.207979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:09.208675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:09.208961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:09.209263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:09.210042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:09.210352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:09.211783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:09.223596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 153/290] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:09.229011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ceaaf-925c-42dd-8fbf-06165410e585 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:09.405358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ceaaf-925c-42dd-8fbf-06165410e585 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:09.476933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662bf44-4c9e-4beb-baa4-3c4f23a2ba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:09.477837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662bf44-4c9e-4beb-baa4-3c4f23a2ba95 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:09.478117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662bf44-4c9e-4beb-baa4-3c4f23a2ba95 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:09.478391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662bf44-4c9e-4beb-baa4-3c4f23a2ba95 None admin] PATH_INFO: `/v3/users/c72036cc4d2c4ebd99a8e883ad37e73a` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:09.481975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662bf44-4c9e-4beb-baa4-3c4f23a2ba95 None admin] RBAC: Authorizing `identity:get_user(user_id=c72036cc4d2c4ebd99a8e883ad37e73a)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:09.483422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662bf44-4c9e-4beb-baa4-3c4f23a2ba95 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:09.485150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 138/291] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:09 2022] GET /identity/v3/users/c72036cc4d2c4ebd99a8e883ad37e73a => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:09.491311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:09.622167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970a72d-8a92-4af4-aa78-13b95463ce44 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:09.671984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604486-844a-4a80-98da-a32d14f0edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:09.672557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604486-844a-4a80-98da-a32d14f0edcc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:09.672836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604486-844a-4a80-98da-a32d14f0edcc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:09.673109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604486-844a-4a80-98da-a32d14f0edcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:09.764363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604486-844a-4a80-98da-a32d14f0edcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:09.765953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604486-844a-4a80-98da-a32d14f0edcc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:09.910928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 154/292] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:09.916696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662bf44-4c9e-4beb-baa4-3c4f23a2ba95 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:10.050572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662bf44-4c9e-4beb-baa4-3c4f23a2ba95 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:10.100803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9303f-57d7-4e0b-bd70-0c777c283c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:10.101723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9303f-57d7-4e0b-bd70-0c777c283c53 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:10.102003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9303f-57d7-4e0b-bd70-0c777c283c53 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:10.102277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9303f-57d7-4e0b-bd70-0c777c283c53 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:10.103609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9303f-57d7-4e0b-bd70-0c777c283c53 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:10.105370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9303f-57d7-4e0b-bd70-0c777c283c53 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:10.107545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 139/293] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:09 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:10.113332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604486-844a-4a80-98da-a32d14f0edcc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:10.285079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604486-844a-4a80-98da-a32d14f0edcc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:10.337993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cfb19-bacb-4959-b429-5378ec1262c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:10.338729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfb19-bacb-4959-b429-5378ec1262c6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:10.339010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfb19-bacb-4959-b429-5378ec1262c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:10.339282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfb19-bacb-4959-b429-5378ec1262c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:10.340136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cfb19-bacb-4959-b429-5378ec1262c6 None admin] RBAC: Adding query filter params (role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=66345118156e4a658492e8c39ca0f753, user.id=c72036cc4d2c4ebd99a8e883ad37e73a) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:10.340446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cfb19-bacb-4959-b429-5378ec1262c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:10.341921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cfb19-bacb-4959-b429-5378ec1262c6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:10.351620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 155/294] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:10 2022] GET /identity/v3/role_assignments?user.id=c72036cc4d2c4ebd99a8e883ad37e73a&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=68f91fa718f44020a307be6b2f10b834 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:11.614367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aeac4-e370-4375-a05c-4fddd23ee685 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.615391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aeac4-e370-4375-a05c-4fddd23ee685 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.615913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aeac4-e370-4375-a05c-4fddd23ee685 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.617521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 140/295] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:11.623178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d34fb-34e6-4ebf-819a-278ea1b69468 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.624292 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d34fb-34e6-4ebf-819a-278ea1b69468 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.624764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d34fb-34e6-4ebf-819a-278ea1b69468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.625472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132fa0-1ae2-4196-a0ad-e065bcb4110a None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.625766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132fa0-1ae2-4196-a0ad-e065bcb4110a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.626047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132fa0-1ae2-4196-a0ad-e065bcb4110a None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.627656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 141/296] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:11.633521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8bfe6-9916-409c-8978-85ff648d7500 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.634083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8bfe6-9916-409c-8978-85ff648d7500 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.634535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8bfe6-9916-409c-8978-85ff648d7500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.645797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-740d34fb-34e6-4ebf-819a-278ea1b69468 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:11.646989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-740d34fb-34e6-4ebf-819a-278ea1b69468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:11.704025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-60f8bfe6-9916-409c-8978-85ff648d7500 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:11.705617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-60f8bfe6-9916-409c-8978-85ff648d7500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:11.779018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 156/297] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:11.779528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 142/298] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:11.780999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667426b-c698-4a7e-82eb-5834dc8a5a7c None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.781533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667426b-c698-4a7e-82eb-5834dc8a5a7c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.781715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e334e8d-7bee-42cb-91c9-ca5a502ff74b None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.782136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e334e8d-7bee-42cb-91c9-ca5a502ff74b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.782505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667426b-c698-4a7e-82eb-5834dc8a5a7c None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.782607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e334e8d-7bee-42cb-91c9-ca5a502ff74b None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.784152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 157/299] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:11.787087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 143/300] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:11.794813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48425c-8046-426f-83ef-af744440d47f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.795290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48425c-8046-426f-83ef-af744440d47f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.795734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48425c-8046-426f-83ef-af744440d47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.798810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27eb35-2de4-4974-9aad-de48c08f0998 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.799702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27eb35-2de4-4974-9aad-de48c08f0998 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.800334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27eb35-2de4-4974-9aad-de48c08f0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.814382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4c48425c-8046-426f-83ef-af744440d47f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:11.816312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4c48425c-8046-426f-83ef-af744440d47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:11.828933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7b27eb35-2de4-4974-9aad-de48c08f0998 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:11.831024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7b27eb35-2de4-4974-9aad-de48c08f0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:11.882338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 158/301] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:11.884331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48425c-8046-426f-83ef-af744440d47f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:11.928394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 144/302] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:11.929434 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27eb35-2de4-4974-9aad-de48c08f0998 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:11.986626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48425c-8046-426f-83ef-af744440d47f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.019134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf906f7-5457-4fd9-b0cf-610abf70cc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.020439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf906f7-5457-4fd9-b0cf-610abf70cc66 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.020821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf906f7-5457-4fd9-b0cf-610abf70cc66 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.021082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf906f7-5457-4fd9-b0cf-610abf70cc66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.026449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27eb35-2de4-4974-9aad-de48c08f0998 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.031650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf906f7-5457-4fd9-b0cf-610abf70cc66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-bcf906f7-5457-4fd9-b0cf-610abf70cc66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:12.040598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:12.041635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:12.042429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 159/303] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:12.043112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf906f7-5457-4fd9-b0cf-610abf70cc66 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.067327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708441a-d1a5-4669-8c04-98af08c8f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.068219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708441a-d1a5-4669-8c04-98af08c8f3b9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.068491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708441a-d1a5-4669-8c04-98af08c8f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.068759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708441a-d1a5-4669-8c04-98af08c8f3b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.080260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708441a-d1a5-4669-8c04-98af08c8f3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-4708441a-d1a5-4669-8c04-98af08c8f3b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:12.088838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:12.089827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:12.090615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 145/304] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:12.091258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708441a-d1a5-4669-8c04-98af08c8f3b9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.156571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf906f7-5457-4fd9-b0cf-610abf70cc66 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.194192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05b182-b909-4375-b1af-8d77d7ab2f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.195004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05b182-b909-4375-b1af-8d77d7ab2f3f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.195286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05b182-b909-4375-b1af-8d77d7ab2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.195557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05b182-b909-4375-b1af-8d77d7ab2f3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.196782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05b182-b909-4375-b1af-8d77d7ab2f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:12.198274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05b182-b909-4375-b1af-8d77d7ab2f3f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:12.200095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 160/305] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:12.200708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05b182-b909-4375-b1af-8d77d7ab2f3f None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.214384 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708441a-d1a5-4669-8c04-98af08c8f3b9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.247317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572a31b-452b-4d28-9bdd-06fdfbb1e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.248106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572a31b-452b-4d28-9bdd-06fdfbb1e5cc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.248438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572a31b-452b-4d28-9bdd-06fdfbb1e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.248712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572a31b-452b-4d28-9bdd-06fdfbb1e5cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.259631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572a31b-452b-4d28-9bdd-06fdfbb1e5cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-a572a31b-452b-4d28-9bdd-06fdfbb1e5cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:12.267474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:12.268349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:12.269125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 146/306] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:12.270471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572a31b-452b-4d28-9bdd-06fdfbb1e5cc None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.304964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05b182-b909-4375-b1af-8d77d7ab2f3f None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.338276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.338945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.339219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.339489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.340234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:12.340541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:12.341941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:12.350150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 161/307] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:12.350946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.374189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572a31b-452b-4d28-9bdd-06fdfbb1e5cc None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.410597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.411414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.411675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.411955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.412702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:12.413007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:12.414431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:12.422563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 147/308] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:12.423373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.452499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d863b-2066-42b9-a2cb-c69a947492a3 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.487604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7bd9d-06cc-4d04-9d61-da1ec4d8b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.488287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7bd9d-06cc-4d04-9d61-da1ec4d8b47e None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.489156 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7bd9d-06cc-4d04-9d61-da1ec4d8b47e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.489465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7bd9d-06cc-4d04-9d61-da1ec4d8b47e None admin] PATH_INFO: `/v3/groups` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.490163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7bd9d-06cc-4d04-9d61-da1ec4d8b47e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:12.491634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7bd9d-06cc-4d04-9d61-da1ec4d8b47e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:12.529912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e882d-cd18-43a7-9b93-393ef7f21265 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.562649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.563337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.563604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.563880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.564624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:12.564929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:12.566320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:12.575584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 148/309] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:12.576491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.585896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 162/310] 10.222.0.69 () {60 vars in 1134 bytes} [Wed May 4 13:41:12 2022] POST /identity/v3/groups => generated 229 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:12.588763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7bd9d-06cc-4d04-9d61-da1ec4d8b47e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.692321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2700032-ebd9-4e1e-a685-080d6aaf73e9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.705557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7bd9d-06cc-4d04-9d61-da1ec4d8b47e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.796499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ac92e-b762-422e-8b99-178f3dcaa8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.797906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac92e-b762-422e-8b99-178f3dcaa8ca None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.798253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac92e-b762-422e-8b99-178f3dcaa8ca None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.798412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b218643-625d-4161-9de6-c72442e1f68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.798510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac92e-b762-422e-8b99-178f3dcaa8ca None admin] PATH_INFO: `/v3/users/f81b558586a44d6583ec56c2b6ddd134` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.799253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b218643-625d-4161-9de6-c72442e1f68c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.799543 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b218643-625d-4161-9de6-c72442e1f68c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.799801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b218643-625d-4161-9de6-c72442e1f68c None admin] PATH_INFO: `/v3/users/3de1a94ee64e4cd3a4418b4ee70f8c86` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.802072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b218643-625d-4161-9de6-c72442e1f68c None admin] RBAC: Authorizing `identity:get_user(user_id=3de1a94ee64e4cd3a4418b4ee70f8c86)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:12.803701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b218643-625d-4161-9de6-c72442e1f68c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:12.805459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 163/311] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/users/3de1a94ee64e4cd3a4418b4ee70f8c86 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:12.806237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b218643-625d-4161-9de6-c72442e1f68c None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.817360 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ac92e-b762-422e-8b99-178f3dcaa8ca None admin] RBAC: Authorizing `identity:get_user(user_id=f81b558586a44d6583ec56c2b6ddd134)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:12.862894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ac92e-b762-422e-8b99-178f3dcaa8ca None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:12.862894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 149/312] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/users/f81b558586a44d6583ec56c2b6ddd134 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:12.862894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ac92e-b762-422e-8b99-178f3dcaa8ca None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.928878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b218643-625d-4161-9de6-c72442e1f68c None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.937507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ac92e-b762-422e-8b99-178f3dcaa8ca None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:12.965959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b15c7-c941-46ce-8b52-b0023a32026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.966757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b15c7-c941-46ce-8b52-b0023a32026a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.967039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b15c7-c941-46ce-8b52-b0023a32026a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.967315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b15c7-c941-46ce-8b52-b0023a32026a None admin] PATH_INFO: `/v3/users/10c6e50becbe4674b2e5db8ed6d4db1c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:12.968505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b15c7-c941-46ce-8b52-b0023a32026a None admin] RBAC: Authorizing `identity:get_user(user_id=10c6e50becbe4674b2e5db8ed6d4db1c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:12.970003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b15c7-c941-46ce-8b52-b0023a32026a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:12.971868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 164/313] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/users/10c6e50becbe4674b2e5db8ed6d4db1c => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:12.972420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b15c7-c941-46ce-8b52-b0023a32026a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:12.980252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd6dc-8b5f-4472-84d0-5ed308076169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:12.980956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd6dc-8b5f-4472-84d0-5ed308076169 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:12.981264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd6dc-8b5f-4472-84d0-5ed308076169 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:12.981540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd6dc-8b5f-4472-84d0-5ed308076169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:13.052668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fd6dc-8b5f-4472-84d0-5ed308076169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:13.054313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fd6dc-8b5f-4472-84d0-5ed308076169 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:13.079545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b15c7-c941-46ce-8b52-b0023a32026a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:13.117970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:13.118640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:13.118924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:13.119194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:13.120045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] RBAC: Adding query filter params (role.id=f0fe679843d746969573ffe11d85ee3b, user.id=f81b558586a44d6583ec56c2b6ddd134, scope.system=all) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:13.120373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:13.121968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:13.137585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 165/314] 10.222.0.69 () {56 vars in 1308 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/role_assignments?user.id=f81b558586a44d6583ec56c2b6ddd134&scope.system=all&role.id=f0fe679843d746969573ffe11d85ee3b => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:13.137585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:13.170850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 150/315] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:13.177938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd6dc-8b5f-4472-84d0-5ed308076169 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:13.259071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f9ec-ceef-4d1a-a878-054f85451728 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:13.287258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd6dc-8b5f-4472-84d0-5ed308076169 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:13.296005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff791912-2ecf-458a-975a-78f635e6d672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:13.296842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791912-2ecf-458a-975a-78f635e6d672 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:13.297128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791912-2ecf-458a-975a-78f635e6d672 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:13.297438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791912-2ecf-458a-975a-78f635e6d672 None admin] PATH_INFO: `/v3/system/users/10c6e50becbe4674b2e5db8ed6d4db1c/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:13.299128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff791912-2ecf-458a-975a-78f635e6d672 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=10c6e50becbe4674b2e5db8ed6d4db1c, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:13.300757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff791912-2ecf-458a-975a-78f635e6d672 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:13.326845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5d461-58ef-4890-8599-a99b0f7050f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:13.328073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5d461-58ef-4890-8599-a99b0f7050f0 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:13.328522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5d461-58ef-4890-8599-a99b0f7050f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:13.328959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5d461-58ef-4890-8599-a99b0f7050f0 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:13.330461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5d461-58ef-4890-8599-a99b0f7050f0 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:13.332834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5d461-58ef-4890-8599-a99b0f7050f0 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:13.334892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 151/316] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:13 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:13.340671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5d461-58ef-4890-8599-a99b0f7050f0 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:13.446336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5d461-58ef-4890-8599-a99b0f7050f0 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:13.473571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 166/317] 10.222.0.69 () {58 vars in 1334 bytes} [Wed May 4 13:41:13 2022] PUT /identity/v3/system/users/10c6e50becbe4674b2e5db8ed6d4db1c/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:13.486791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5ba45-df52-4266-8d62-f1cad4c619f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:13.488009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5ba45-df52-4266-8d62-f1cad4c619f6 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:13.488996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5ba45-df52-4266-8d62-f1cad4c619f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:13.489509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5ba45-df52-4266-8d62-f1cad4c619f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:13.490559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5ba45-df52-4266-8d62-f1cad4c619f6 None admin] RBAC: Adding query filter params (role.id=f0fe679843d746969573ffe11d85ee3b, scope.project.id=66345118156e4a658492e8c39ca0f753, user.id=3de1a94ee64e4cd3a4418b4ee70f8c86) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:13.491087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5ba45-df52-4266-8d62-f1cad4c619f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:13.492982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5ba45-df52-4266-8d62-f1cad4c619f6 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:13.500742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 152/318] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:13 2022] GET /identity/v3/role_assignments?user.id=3de1a94ee64e4cd3a4418b4ee70f8c86&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=f0fe679843d746969573ffe11d85ee3b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:15.001010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4397-8be8-4fc9-bf91-7802a807a99f None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.002050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4397-8be8-4fc9-bf91-7802a807a99f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.002540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4397-8be8-4fc9-bf91-7802a807a99f None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.004760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 167/319] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:15.010905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bd3df-4c83-4c47-84e2-a6f8b7c71e5c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.012070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bd3df-4c83-4c47-84e2-a6f8b7c71e5c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.012070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bd3df-4c83-4c47-84e2-a6f8b7c71e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.030057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3a1bd3df-4c83-4c47-84e2-a6f8b7c71e5c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:15.031339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3a1bd3df-4c83-4c47-84e2-a6f8b7c71e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:15.102195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 153/320] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:15.125561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4397-8be8-4fc9-bf91-7802a807a99f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:15.237389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4397-8be8-4fc9-bf91-7802a807a99f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:15.273984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1e6e3-433c-437d-a024-f4ead14715ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:15.275144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1e6e3-433c-437d-a024-f4ead14715ed None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.275626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1e6e3-433c-437d-a024-f4ead14715ed None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.276125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1e6e3-433c-437d-a024-f4ead14715ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.277714 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1e6e3-433c-437d-a024-f4ead14715ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:15.279421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1e6e3-433c-437d-a024-f4ead14715ed None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:15.281951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 168/321] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:15.288720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bd3df-4c83-4c47-84e2-a6f8b7c71e5c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:15.394692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bd3df-4c83-4c47-84e2-a6f8b7c71e5c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:15.430774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060df41-8366-4ed8-bca7-e84e3b7c5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:15.431837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060df41-8366-4ed8-bca7-e84e3b7c5fdf None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.432298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060df41-8366-4ed8-bca7-e84e3b7c5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.432753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060df41-8366-4ed8-bca7-e84e3b7c5fdf None admin] PATH_INFO: `/v3/groups` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.433979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060df41-8366-4ed8-bca7-e84e3b7c5fdf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:15.436453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060df41-8366-4ed8-bca7-e84e3b7c5fdf None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:15.480376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff6a4-f7fe-48b7-b7e8-ad66836f64e6 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.480706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff6a4-f7fe-48b7-b7e8-ad66836f64e6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.480936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff6a4-f7fe-48b7-b7e8-ad66836f64e6 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.482518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 169/322] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:15.487563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9050-28af-4ee4-b0dc-5e7888e20d7e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.487844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9050-28af-4ee4-b0dc-5e7888e20d7e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.488113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9050-28af-4ee4-b0dc-5e7888e20d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.506473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-130a9050-28af-4ee4-b0dc-5e7888e20d7e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:15.507658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-130a9050-28af-4ee4-b0dc-5e7888e20d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:15.551841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 154/323] 10.222.0.69 () {60 vars in 1134 bytes} [Wed May 4 13:41:15 2022] POST /identity/v3/groups => generated 226 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:15.585887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 170/324] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:15.611646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060df41-8366-4ed8-bca7-e84e3b7c5fdf None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:15.748420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060df41-8366-4ed8-bca7-e84e3b7c5fdf None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:15.789316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b17d-cb9b-4b63-8724-7fee046b4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:15.790129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b17d-cb9b-4b63-8724-7fee046b4ffb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.790449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b17d-cb9b-4b63-8724-7fee046b4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.790745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b17d-cb9b-4b63-8724-7fee046b4ffb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.802645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3b17d-cb9b-4b63-8724-7fee046b4ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-16f3b17d-cb9b-4b63-8724-7fee046b4ffb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:15.815271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:15.816440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:15.818285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 155/325] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:15.825529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9050-28af-4ee4-b0dc-5e7888e20d7e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:15.845969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d94e0-cb01-435d-bddf-c065a36006dd None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.846252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d94e0-cb01-435d-bddf-c065a36006dd None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.846713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d94e0-cb01-435d-bddf-c065a36006dd None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.849631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 156/326] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:15.855456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b501e8-282e-4d27-b18a-4268634b6e9f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.855737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b501e8-282e-4d27-b18a-4268634b6e9f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.856012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b501e8-282e-4d27-b18a-4268634b6e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.878145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-30b501e8-282e-4d27-b18a-4268634b6e9f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:15.878145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-30b501e8-282e-4d27-b18a-4268634b6e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:15.948116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9050-28af-4ee4-b0dc-5e7888e20d7e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:15.957512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 157/327] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:15.981827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b501e8-282e-4d27-b18a-4268634b6e9f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:15.985604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:15.986338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:15.986621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:15.986899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:15.987660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:15.988027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:15.990152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:15.999408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 171/328] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:16.006387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:16.090620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b501e8-282e-4d27-b18a-4268634b6e9f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:16.122232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40682b1f-f230-4a84-be93-7243d01c99b6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:16.126856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54582e8a-b1f2-4ce2-b2b3-d0fcb8a9198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:16.127666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582e8a-b1f2-4ce2-b2b3-d0fcb8a9198d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:16.127949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582e8a-b1f2-4ce2-b2b3-d0fcb8a9198d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:16.128226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582e8a-b1f2-4ce2-b2b3-d0fcb8a9198d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:16.139615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54582e8a-b1f2-4ce2-b2b3-d0fcb8a9198d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-54582e8a-b1f2-4ce2-b2b3-d0fcb8a9198d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:16.147504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:16.148440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:16.149480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 158/329] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:16.159506 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54582e8a-b1f2-4ce2-b2b3-d0fcb8a9198d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:16.167778 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7d3fb-90f7-422d-9e21-813d3884b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:16.168723 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d3fb-90f7-422d-9e21-813d3884b31e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:16.169003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d3fb-90f7-422d-9e21-813d3884b31e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:16.169342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7d3fb-90f7-422d-9e21-813d3884b31e None admin] PATH_INFO: `/v3/users/f81b558586a44d6583ec56c2b6ddd134` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:16.170531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7d3fb-90f7-422d-9e21-813d3884b31e None admin] RBAC: Authorizing `identity:get_user(user_id=f81b558586a44d6583ec56c2b6ddd134)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:16.172902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7d3fb-90f7-422d-9e21-813d3884b31e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:16.175496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 172/330] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:16 2022] GET /identity/v3/users/f81b558586a44d6583ec56c2b6ddd134 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:16.181858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7d3fb-90f7-422d-9e21-813d3884b31e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:16.269324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54582e8a-b1f2-4ce2-b2b3-d0fcb8a9198d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:16.290451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7d3fb-90f7-422d-9e21-813d3884b31e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:16.308228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:16.309293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:16.309797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:16.310266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:16.311341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] RBAC: Adding query filter params (name=member) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:16.311847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:16.313460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:16.327511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 159/331] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:16.329202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:16.331034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f10e6-2789-4cd4-b655-d5245c79d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:16.331916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f10e6-2789-4cd4-b655-d5245c79d447 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:16.332264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f10e6-2789-4cd4-b655-d5245c79d447 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:16.332543 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f10e6-2789-4cd4-b655-d5245c79d447 None admin] PATH_INFO: `/v3/system/users/f81b558586a44d6583ec56c2b6ddd134/roles/f0fe679843d746969573ffe11d85ee3b` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:16.334362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f10e6-2789-4cd4-b655-d5245c79d447 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f81b558586a44d6583ec56c2b6ddd134, role_id=f0fe679843d746969573ffe11d85ee3b)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:16.336301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f10e6-2789-4cd4-b655-d5245c79d447 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:16.444150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71586d21-3e93-4f9d-91da-a0fec56f66fb None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:16.481418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675627e0-5bde-4b47-bb65-fe081efca299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:16.482303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675627e0-5bde-4b47-bb65-fe081efca299 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:16.482586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675627e0-5bde-4b47-bb65-fe081efca299 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:16.482860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675627e0-5bde-4b47-bb65-fe081efca299 None admin] PATH_INFO: `/v3/users/10c6e50becbe4674b2e5db8ed6d4db1c` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:16.484091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675627e0-5bde-4b47-bb65-fe081efca299 None admin] RBAC: Authorizing `identity:get_user(user_id=10c6e50becbe4674b2e5db8ed6d4db1c)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:16.485657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675627e0-5bde-4b47-bb65-fe081efca299 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:16.487623 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 160/332] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:16 2022] GET /identity/v3/users/10c6e50becbe4674b2e5db8ed6d4db1c => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:16.494135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675627e0-5bde-4b47-bb65-fe081efca299 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:16.494440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 173/333] 10.222.0.69 () {58 vars in 1334 bytes} [Wed May 4 13:41:16 2022] PUT /identity/v3/system/users/f81b558586a44d6583ec56c2b6ddd134/roles/f0fe679843d746969573ffe11d85ee3b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:41:16.610470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675627e0-5bde-4b47-bb65-fe081efca299 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:16.647737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0b8ea-1551-4dca-908b-7746d17eb91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:16.648527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0b8ea-1551-4dca-908b-7746d17eb91e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:16.648816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0b8ea-1551-4dca-908b-7746d17eb91e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:16.649106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0b8ea-1551-4dca-908b-7746d17eb91e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:16.649999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0b8ea-1551-4dca-908b-7746d17eb91e None admin] RBAC: Adding query filter params (role.id=68f91fa718f44020a307be6b2f10b834, user.id=10c6e50becbe4674b2e5db8ed6d4db1c, scope.system=all) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:16.650316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0b8ea-1551-4dca-908b-7746d17eb91e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:16.651919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0b8ea-1551-4dca-908b-7746d17eb91e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:16.671773 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 161/334] 10.222.0.69 () {56 vars in 1308 bytes} [Wed May 4 13:41:16 2022] GET /identity/v3/role_assignments?user.id=10c6e50becbe4674b2e5db8ed6d4db1c&scope.system=all&role.id=68f91fa718f44020a307be6b2f10b834 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:18.882821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359123ca-4342-419f-8420-9495d186ac63 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:18.883335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359123ca-4342-419f-8420-9495d186ac63 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:18.883443 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359123ca-4342-419f-8420-9495d186ac63 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:18.884764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 174/335] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:18.890690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8f0b6-d8d3-4141-9f73-8ea1bc48c0a4 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:18.891602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8f0b6-d8d3-4141-9f73-8ea1bc48c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:18.892078 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8f0b6-d8d3-4141-9f73-8ea1bc48c0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:18.915774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f3d8f0b6-d8d3-4141-9f73-8ea1bc48c0a4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:18.917439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f3d8f0b6-d8d3-4141-9f73-8ea1bc48c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:18.998670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 162/336] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:19.025180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359123ca-4342-419f-8420-9495d186ac63 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:19.054070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f11c4-2ae6-49e8-95c1-140fd4b53643 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.055029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f11c4-2ae6-49e8-95c1-140fd4b53643 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.055506 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f11c4-2ae6-49e8-95c1-140fd4b53643 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.058201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 163/337] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:19.068463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdcf7f-a1ff-442f-8d2a-7b0efa0ace88 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.069367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdcf7f-a1ff-442f-8d2a-7b0efa0ace88 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.069971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdcf7f-a1ff-442f-8d2a-7b0efa0ace88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.092277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-80bdcf7f-a1ff-442f-8d2a-7b0efa0ace88 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:19.094487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-80bdcf7f-a1ff-442f-8d2a-7b0efa0ace88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:19.176679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 164/338] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:19.198021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359123ca-4342-419f-8420-9495d186ac63 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:19.217267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdcf7f-a1ff-442f-8d2a-7b0efa0ace88 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:19.253629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a1264-a061-4172-b770-d1e1e31a6f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:19.255791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1264-a061-4172-b770-d1e1e31a6f81 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.256302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1264-a061-4172-b770-d1e1e31a6f81 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.256784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1264-a061-4172-b770-d1e1e31a6f81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.270643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a1264-a061-4172-b770-d1e1e31a6f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-1d7a1264-a061-4172-b770-d1e1e31a6f81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:19.282383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:19.283303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:19.284088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:19.288765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 175/339] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:19.295639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f1f5-5849-41e8-87d2-975f6bd885ad None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.296170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f1f5-5849-41e8-87d2-975f6bd885ad None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.296667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f1f5-5849-41e8-87d2-975f6bd885ad None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.298675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 176/340] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:19.302720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37f1f5-5849-41e8-87d2-975f6bd885ad None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:19.432901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37f1f5-5849-41e8-87d2-975f6bd885ad None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:19.455619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdcf7f-a1ff-442f-8d2a-7b0efa0ace88 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:19.476426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9f65b-c918-4520-92c1-3e5b5fe66b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:19.477724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f65b-c918-4520-92c1-3e5b5fe66b79 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.478227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f65b-c918-4520-92c1-3e5b5fe66b79 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.478845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f65b-c918-4520-92c1-3e5b5fe66b79 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.480079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9f65b-c918-4520-92c1-3e5b5fe66b79 None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:19.480586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9f65b-c918-4520-92c1-3e5b5fe66b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:19.482703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9f65b-c918-4520-92c1-3e5b5fe66b79 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:19.496798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 177/341] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:19.503162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b433-7969-4d9a-8de4-47e967cbdfc9 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.503811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b433-7969-4d9a-8de4-47e967cbdfc9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.506105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6b433-7969-4d9a-8de4-47e967cbdfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.528362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363b613-b52e-420e-9c1e-3d6534e4f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:19.529597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363b613-b52e-420e-9c1e-3d6534e4f715 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.530117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363b613-b52e-420e-9c1e-3d6534e4f715 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.530240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4ed6b433-7969-4d9a-8de4-47e967cbdfc9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:19.530705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363b613-b52e-420e-9c1e-3d6534e4f715 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.531566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4ed6b433-7969-4d9a-8de4-47e967cbdfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:19.543903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363b613-b52e-420e-9c1e-3d6534e4f715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e363b613-b52e-420e-9c1e-3d6534e4f715 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:19.556501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:19.557496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:19.558299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:19.561095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 165/342] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:41:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:19.562983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f527c0-6b84-4485-88f8-a23da4d46c15 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.563481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f527c0-6b84-4485-88f8-a23da4d46c15 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.563950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f527c0-6b84-4485-88f8-a23da4d46c15 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.565523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 166/343] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:19.566568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f527c0-6b84-4485-88f8-a23da4d46c15 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:19.634722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 178/344] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:19.634722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b433-7969-4d9a-8de4-47e967cbdfc9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:19.765271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f527c0-6b84-4485-88f8-a23da4d46c15 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:19.796594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6b433-7969-4d9a-8de4-47e967cbdfc9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:19.797622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a735f02-7c8b-4cb0-9bea-fade1d22bae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:19.798274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735f02-7c8b-4cb0-9bea-fade1d22bae1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.798555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735f02-7c8b-4cb0-9bea-fade1d22bae1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.798827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735f02-7c8b-4cb0-9bea-fade1d22bae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.834858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5cc52-c3ba-4a37-9e75-6719ad516a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:19.835548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5cc52-c3ba-4a37-9e75-6719ad516a9c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.835893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5cc52-c3ba-4a37-9e75-6719ad516a9c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.836166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5cc52-c3ba-4a37-9e75-6719ad516a9c None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.836978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5cc52-c3ba-4a37-9e75-6719ad516a9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:19.837313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5cc52-c3ba-4a37-9e75-6719ad516a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:19.838727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5cc52-c3ba-4a37-9e75-6719ad516a9c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:19.850023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 179/345] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:19.851354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b265a0-2341-4109-a14f-7b1e199eee76 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:19.857036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b265a0-2341-4109-a14f-7b1e199eee76 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:19.857549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b265a0-2341-4109-a14f-7b1e199eee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:19.872570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a735f02-7c8b-4cb0-9bea-fade1d22bae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:19.874070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a735f02-7c8b-4cb0-9bea-fade1d22bae1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:19.876681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-11b265a0-2341-4109-a14f-7b1e199eee76 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:19.877925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-11b265a0-2341-4109-a14f-7b1e199eee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:19.966392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 180/346] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:19.968014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b265a0-2341-4109-a14f-7b1e199eee76 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.002573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 167/347] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:20.004181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a735f02-7c8b-4cb0-9bea-fade1d22bae1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.122759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b265a0-2341-4109-a14f-7b1e199eee76 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.134512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a735f02-7c8b-4cb0-9bea-fade1d22bae1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.174606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bba28-8b1c-4683-8df8-a8b89580e8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:20.175418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bba28-8b1c-4683-8df8-a8b89580e8ad None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.176266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bba28-8b1c-4683-8df8-a8b89580e8ad None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.177355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bba28-8b1c-4683-8df8-a8b89580e8ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.178101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bccf4-e69f-4131-9f86-a0f50dfb9f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:20.179003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bccf4-e69f-4131-9f86-a0f50dfb9f89 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.179494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bccf4-e69f-4131-9f86-a0f50dfb9f89 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.179975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bccf4-e69f-4131-9f86-a0f50dfb9f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.191057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bba28-8b1c-4683-8df8-a8b89580e8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-ff1bba28-8b1c-4683-8df8-a8b89580e8ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:20.202405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:20.203385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:20.204182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 181/348] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:20.205062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bba28-8b1c-4683-8df8-a8b89580e8ad None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.264792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bccf4-e69f-4131-9f86-a0f50dfb9f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:20.266953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bccf4-e69f-4131-9f86-a0f50dfb9f89 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:20.320348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bba28-8b1c-4683-8df8-a8b89580e8ad None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.357910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f3d4-34cc-4e14-8284-a006589c603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:20.358737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f3d4-34cc-4e14-8284-a006589c603c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.359268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f3d4-34cc-4e14-8284-a006589c603c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.359268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f3d4-34cc-4e14-8284-a006589c603c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.372969 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2f3d4-34cc-4e14-8284-a006589c603c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:20.381921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 168/349] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:20.383164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bccf4-e69f-4131-9f86-a0f50dfb9f89 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-d1f2f3d4-34cc-4e14-8284-a006589c603c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:20.387440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:20.388400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:20.389167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 182/350] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:20.389850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f3d4-34cc-4e14-8284-a006589c603c None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.523526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f3d4-34cc-4e14-8284-a006589c603c None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.524035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bccf4-e69f-4131-9f86-a0f50dfb9f89 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.570412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84335299-cf95-416f-8ca2-877d533f74e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:20.571844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84335299-cf95-416f-8ca2-877d533f74e7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.572397 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84335299-cf95-416f-8ca2-877d533f74e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.573300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84335299-cf95-416f-8ca2-877d533f74e7 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.575519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84335299-cf95-416f-8ca2-877d533f74e7 None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:20.576967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84335299-cf95-416f-8ca2-877d533f74e7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:20.580474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 169/351] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:20 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:20.580849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84335299-cf95-416f-8ca2-877d533f74e7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.591902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:20.593120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.594605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.594724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.600876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:20.600876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:20.600876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:20.614468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 183/352] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:20.615545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.706174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84335299-cf95-416f-8ca2-877d533f74e7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.747861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149caa-f584-406a-87a4-757b63fb1676 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.773445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470f192-c0f0-4967-9373-3c04b860432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:20.774356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470f192-c0f0-4967-9373-3c04b860432b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.774665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470f192-c0f0-4967-9373-3c04b860432b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.774918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470f192-c0f0-4967-9373-3c04b860432b None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.776419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470f192-c0f0-4967-9373-3c04b860432b None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:20.778014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470f192-c0f0-4967-9373-3c04b860432b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:20.780231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 170/353] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:20 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:20.781643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860af9-ca7a-4a5d-abf2-e03f98852a2f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.781920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860af9-ca7a-4a5d-abf2-e03f98852a2f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.782197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2860af9-ca7a-4a5d-abf2-e03f98852a2f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.787600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 171/354] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:20.788481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2860af9-ca7a-4a5d-abf2-e03f98852a2f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.808982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:20.809837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.810188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.810534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.811371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:20.811682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:20.813081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:20.826366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 184/355] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:20.826863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:20.935858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2860af9-ca7a-4a5d-abf2-e03f98852a2f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.972096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0746-776c-44a1-a6fc-56fbd6e3c09c None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:20.988933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6167622-2b14-475a-823b-a6f76520a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:20.990319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167622-2b14-475a-823b-a6f76520a651 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:20.990602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167622-2b14-475a-823b-a6f76520a651 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:20.990878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6167622-2b14-475a-823b-a6f76520a651 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:20.998802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6167622-2b14-475a-823b-a6f76520a651 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:21.000571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6167622-2b14-475a-823b-a6f76520a651 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:21.002892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 172/356] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:20 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:21.003866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6167622-2b14-475a-823b-a6f76520a651 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:21.017435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670b46-4732-4176-a050-7cf346692935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:21.018192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670b46-4732-4176-a050-7cf346692935 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.018514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670b46-4732-4176-a050-7cf346692935 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.018758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670b46-4732-4176-a050-7cf346692935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.104991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670b46-4732-4176-a050-7cf346692935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:21.106502 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670b46-4732-4176-a050-7cf346692935 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:21.126290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6167622-2b14-475a-823b-a6f76520a651 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:21.171515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c4916-4d5e-4086-a84c-b30183a9d997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:21.172050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c4916-4d5e-4086-a84c-b30183a9d997 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.172334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c4916-4d5e-4086-a84c-b30183a9d997 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.172620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c4916-4d5e-4086-a84c-b30183a9d997 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.174904 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c4916-4d5e-4086-a84c-b30183a9d997 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:21.176817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c4916-4d5e-4086-a84c-b30183a9d997 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:21.179000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 173/357] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:21 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:21.180748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6b162-4384-42e3-8cda-98e9261cb4ab None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.180748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6b162-4384-42e3-8cda-98e9261cb4ab None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.180748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6b162-4384-42e3-8cda-98e9261cb4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.201602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-45e6b162-4384-42e3-8cda-98e9261cb4ab None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:21.203008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-45e6b162-4384-42e3-8cda-98e9261cb4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:21.245314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 185/358] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:21.245314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670b46-4732-4176-a050-7cf346692935 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:21.291142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 174/359] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:21.292940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183165-7f26-42fc-91e2-e0524a53912d None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.293445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183165-7f26-42fc-91e2-e0524a53912d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.293893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183165-7f26-42fc-91e2-e0524a53912d None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.295419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 175/360] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:21.296406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd183165-7f26-42fc-91e2-e0524a53912d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:21.384740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670b46-4732-4176-a050-7cf346692935 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:21.425122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0112107-68a6-4185-9bdd-7d630679c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:21.425349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd183165-7f26-42fc-91e2-e0524a53912d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:21.426799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0112107-68a6-4185-9bdd-7d630679c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.427322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0112107-68a6-4185-9bdd-7d630679c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.427322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0112107-68a6-4185-9bdd-7d630679c1f1 None admin] PATH_INFO: `/v3/users/f81b558586a44d6583ec56c2b6ddd134` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.428616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0112107-68a6-4185-9bdd-7d630679c1f1 None admin] RBAC: Authorizing `identity:get_user(user_id=f81b558586a44d6583ec56c2b6ddd134)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:21.430120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0112107-68a6-4185-9bdd-7d630679c1f1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:21.431808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 186/361] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:41:21 2022] GET /identity/v3/users/f81b558586a44d6583ec56c2b6ddd134 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:21.433783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0112107-68a6-4185-9bdd-7d630679c1f1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:21.468505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:21.469173 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.469527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.470017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.470881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] RBAC: Adding query filter params (group.id=e9749098c50c4f968dda518a09e9f365, role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=a115aa26e75244d4a57940a1d2497960) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:21.471194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:21.473372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:21.479829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 176/362] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:21 2022] GET /identity/v3/role_assignments?group.id=e9749098c50c4f968dda518a09e9f365&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=68f91fa718f44020a307be6b2f10b834 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:21.480515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:21.590682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0112107-68a6-4185-9bdd-7d630679c1f1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:21.632607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0960c-c066-412e-97b6-30eaeba378d7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:21.640741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8fd9d-c77c-44b5-b45f-635ce9a1b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:21.641850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8fd9d-c77c-44b5-b45f-635ce9a1b84d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.641850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8fd9d-c77c-44b5-b45f-635ce9a1b84d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.642067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8fd9d-c77c-44b5-b45f-635ce9a1b84d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.643073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8fd9d-c77c-44b5-b45f-635ce9a1b84d None admin] RBAC: Adding query filter params (group.id=e9749098c50c4f968dda518a09e9f365, role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=a115aa26e75244d4a57940a1d2497960) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:21.643230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8fd9d-c77c-44b5-b45f-635ce9a1b84d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:21.645927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8fd9d-c77c-44b5-b45f-635ce9a1b84d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:21.654836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 187/363] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:21 2022] GET /identity/v3/role_assignments?group.id=e9749098c50c4f968dda518a09e9f365&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:21.657606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe3c7-2509-4433-8834-3d6ffaac059d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.657869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe3c7-2509-4433-8834-3d6ffaac059d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.658280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe3c7-2509-4433-8834-3d6ffaac059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.686839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1bd2f-cf72-41a0-a068-cd87c3a12114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:21.688484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1bd2f-cf72-41a0-a068-cd87c3a12114 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.689039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1bd2f-cf72-41a0-a068-cd87c3a12114 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.689568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1bd2f-cf72-41a0-a068-cd87c3a12114 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.689784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-9cffe3c7-2509-4433-8834-3d6ffaac059d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:21.691731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1bd2f-cf72-41a0-a068-cd87c3a12114 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:21.692062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9cffe3c7-2509-4433-8834-3d6ffaac059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:21.693933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1bd2f-cf72-41a0-a068-cd87c3a12114 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:21.696511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 177/364] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:21 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:21.697669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1bd2f-cf72-41a0-a068-cd87c3a12114 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:21.824934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 188/365] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:21.826464 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1bd2f-cf72-41a0-a068-cd87c3a12114 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:21.826589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffe3c7-2509-4433-8834-3d6ffaac059d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:21.866767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62899022-e4b9-4ad0-a3a2-3a629ebcb785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:21.867933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899022-e4b9-4ad0-a3a2-3a629ebcb785 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:21.868430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899022-e4b9-4ad0-a3a2-3a629ebcb785 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:21.868906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62899022-e4b9-4ad0-a3a2-3a629ebcb785 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:21.883048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62899022-e4b9-4ad0-a3a2-3a629ebcb785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-62899022-e4b9-4ad0-a3a2-3a629ebcb785 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:21.891643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:21.892810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:21.893636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:21.899223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 178/366] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:41:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:21.899223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62899022-e4b9-4ad0-a3a2-3a629ebcb785 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:21.997446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffe3c7-2509-4433-8834-3d6ffaac059d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.037072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62899022-e4b9-4ad0-a3a2-3a629ebcb785 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.063503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:22.064307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:22.064587 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:22.064859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:22.065896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] RBAC: Adding query filter params (role.id=f0fe679843d746969573ffe11d85ee3b, user.id=f81b558586a44d6583ec56c2b6ddd134, scope.system=all) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:22.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:22.068205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:22.079913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188e81-2447-4b09-bff5-b213b1560426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:22.080784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188e81-2447-4b09-bff5-b213b1560426 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:22.081070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188e81-2447-4b09-bff5-b213b1560426 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:22.081399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188e81-2447-4b09-bff5-b213b1560426 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:22.082819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26188e81-2447-4b09-bff5-b213b1560426 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:22.084364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26188e81-2447-4b09-bff5-b213b1560426 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:22.084822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 189/367] 10.222.0.69 () {56 vars in 1308 bytes} [Wed May 4 13:41:21 2022] GET /identity/v3/role_assignments?user.id=f81b558586a44d6583ec56c2b6ddd134&scope.system=all&role.id=f0fe679843d746969573ffe11d85ee3b => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:22.086075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 179/368] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:21 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:22.086580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:22.091780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188e81-2447-4b09-bff5-b213b1560426 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:22.217577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61773a6-737b-4b6a-9f23-2dc70d779e66 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.228805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188e81-2447-4b09-bff5-b213b1560426 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.256262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352cf14-5580-460b-88bf-7601ed30e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:22.257105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352cf14-5580-460b-88bf-7601ed30e22f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:22.257440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352cf14-5580-460b-88bf-7601ed30e22f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:22.257719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352cf14-5580-460b-88bf-7601ed30e22f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:22.271693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352cf14-5580-460b-88bf-7601ed30e22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:22.274763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:22.275447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:22.275728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:22.276001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:22.276768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:22.277071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:22.278503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-9352cf14-5580-460b-88bf-7601ed30e22f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:22.281441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:22.283531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 190/369] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:22.286307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352cf14-5580-460b-88bf-7601ed30e22f None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:22.294825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 180/370] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:22.294825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:22.413620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352cf14-5580-460b-88bf-7601ed30e22f None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.458385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:22.458918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:22.459208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:22.459490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:22.460355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] RBAC: Adding query filter params (group.id=e9749098c50c4f968dda518a09e9f365, role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=66345118156e4a658492e8c39ca0f753) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:22.460672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:22.462199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:22.468983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 191/371] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:22 2022] GET /identity/v3/role_assignments?group.id=e9749098c50c4f968dda518a09e9f365&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=68f91fa718f44020a307be6b2f10b834 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:22.474067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:22.512525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48dfb-286f-4972-817d-d8255b1683e3 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.562225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:22.562927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:22.563211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:22.563488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:22.564289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:22.564579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:22.566213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:22.576401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 181/372] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:22.586370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:22.616571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5eb13-777d-4d46-b92d-22fb2fdc36f6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.662209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e1a5-54d4-4185-941b-3494dcde01ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:22.662916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e1a5-54d4-4185-941b-3494dcde01ae None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:22.663203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e1a5-54d4-4185-941b-3494dcde01ae None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:22.663664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147e1a5-54d4-4185-941b-3494dcde01ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:22.727688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bed7-35f2-4378-b842-23fc94ae4292 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.750482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147e1a5-54d4-4185-941b-3494dcde01ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:22.750482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147e1a5-54d4-4185-941b-3494dcde01ae None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:22.766408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623334fa-7fd4-4695-9e73-cbc519716354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:22.767081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623334fa-7fd4-4695-9e73-cbc519716354 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:22.767360 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623334fa-7fd4-4695-9e73-cbc519716354 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:22.767634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623334fa-7fd4-4695-9e73-cbc519716354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:22.848040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623334fa-7fd4-4695-9e73-cbc519716354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:22.849844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623334fa-7fd4-4695-9e73-cbc519716354 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:22.869161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 192/373] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:22.878347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e1a5-54d4-4185-941b-3494dcde01ae None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:22.987938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 182/374] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:22.990843 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147e1a5-54d4-4185-941b-3494dcde01ae None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:22.997068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623334fa-7fd4-4695-9e73-cbc519716354 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:23.028736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4e143-e660-4d4c-bf16-10380b02a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:23.029641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e143-e660-4d4c-bf16-10380b02a148 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:23.029989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e143-e660-4d4c-bf16-10380b02a148 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:23.030205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4e143-e660-4d4c-bf16-10380b02a148 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:23.031497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4e143-e660-4d4c-bf16-10380b02a148 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:23.032966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4e143-e660-4d4c-bf16-10380b02a148 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:23.035195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 193/375] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:22 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:23.043147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4e143-e660-4d4c-bf16-10380b02a148 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:23.237705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4e143-e660-4d4c-bf16-10380b02a148 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:23.261676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623334fa-7fd4-4695-9e73-cbc519716354 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:23.299513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea232c1-0c87-43af-8579-5ed5d2b4cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:23.300397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea232c1-0c87-43af-8579-5ed5d2b4cfae None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:23.301279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea232c1-0c87-43af-8579-5ed5d2b4cfae None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:23.301574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea232c1-0c87-43af-8579-5ed5d2b4cfae None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:23.302905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea232c1-0c87-43af-8579-5ed5d2b4cfae None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:23.304456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea232c1-0c87-43af-8579-5ed5d2b4cfae None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:23.306416 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 194/376] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:23 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:23.312332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea232c1-0c87-43af-8579-5ed5d2b4cfae None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:23.367364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc0158-6cf7-46f3-9863-bec5f074b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:23.368514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0158-6cf7-46f3-9863-bec5f074b502 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:23.368805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0158-6cf7-46f3-9863-bec5f074b502 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:23.369222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0158-6cf7-46f3-9863-bec5f074b502 None admin] PATH_INFO: `/v3/projects/9c3182e031164ef9b9b514b600f7699c` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:23.374273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc0158-6cf7-46f3-9863-bec5f074b502 None admin] RBAC: Authorizing `identity:get_project(project_id=9c3182e031164ef9b9b514b600f7699c)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:23.376334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc0158-6cf7-46f3-9863-bec5f074b502 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:23.380231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 183/377] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:22 2022] GET /identity/v3/projects/9c3182e031164ef9b9b514b600f7699c => generated 344 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:23.387191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc0158-6cf7-46f3-9863-bec5f074b502 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:23.456866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea232c1-0c87-43af-8579-5ed5d2b4cfae None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:23.542044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:23.543057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:23.543578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:23.544060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:23.545132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] RBAC: Adding query filter params (group.id=e9749098c50c4f968dda518a09e9f365, role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=66345118156e4a658492e8c39ca0f753) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:23.545704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:23.547378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:23.563330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 195/378] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:23 2022] GET /identity/v3/role_assignments?group.id=e9749098c50c4f968dda518a09e9f365&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:23.570300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc0158-6cf7-46f3-9863-bec5f074b502 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:23.618112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214bc6-700c-4f23-bbed-ec37dfde791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:23.619003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214bc6-700c-4f23-bbed-ec37dfde791b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:23.619287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214bc6-700c-4f23-bbed-ec37dfde791b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:23.619564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214bc6-700c-4f23-bbed-ec37dfde791b None admin] PATH_INFO: `/v3/groups/950e4c19558c480299d07e289a9eb2c4` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:23.625738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214bc6-700c-4f23-bbed-ec37dfde791b None admin] RBAC: Authorizing `identity:get_group(group_id=950e4c19558c480299d07e289a9eb2c4)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:23.627210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214bc6-700c-4f23-bbed-ec37dfde791b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:23.629613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 184/379] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:23 2022] GET /identity/v3/groups/950e4c19558c480299d07e289a9eb2c4 => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:23.635867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:23.775547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376ad04-283d-4a36-84b6-119cb51e926d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:23.817441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769058f-e388-40f6-85c8-11d5a564e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:23.818065 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769058f-e388-40f6-85c8-11d5a564e712 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:23.818350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769058f-e388-40f6-85c8-11d5a564e712 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:23.818626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769058f-e388-40f6-85c8-11d5a564e712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:23.819494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769058f-e388-40f6-85c8-11d5a564e712 None admin] RBAC: Adding query filter params (group.id=950e4c19558c480299d07e289a9eb2c4, role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=9c3182e031164ef9b9b514b600f7699c) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:23.819807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769058f-e388-40f6-85c8-11d5a564e712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:23.821339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769058f-e388-40f6-85c8-11d5a564e712 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:23.828445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 196/380] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:23 2022] GET /identity/v3/role_assignments?group.id=950e4c19558c480299d07e289a9eb2c4&scope.project.id=9c3182e031164ef9b9b514b600f7699c&role.id=f1d6bdc882c24a2a9389961135865317 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:24.859702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b61f-e95f-4f07-b288-3619a10eb6c3 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:24.860242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b61f-e95f-4f07-b288-3619a10eb6c3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:24.860242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b61f-e95f-4f07-b288-3619a10eb6c3 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:24.861685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 185/381] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:24.868280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4659-1b8c-4074-b72b-4c52447fd5c6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:24.868795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4659-1b8c-4074-b72b-4c52447fd5c6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:24.868904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4659-1b8c-4074-b72b-4c52447fd5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:24.892395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ee6a4659-1b8c-4074-b72b-4c52447fd5c6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:24.893631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ee6a4659-1b8c-4074-b72b-4c52447fd5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:24.977558 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 197/382] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:25.012950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b61f-e95f-4f07-b288-3619a10eb6c3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:25.167969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b61f-e95f-4f07-b288-3619a10eb6c3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:25.195186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e0b1c-4ff8-47b6-b395-403697e225bb None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:25.195531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e0b1c-4ff8-47b6-b395-403697e225bb None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:25.195745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e0b1c-4ff8-47b6-b395-403697e225bb None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:25.201518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 198/383] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:25.208443 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f99ae-9adf-4f5b-91a1-8888173d7dda None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:25.208744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f99ae-9adf-4f5b-91a1-8888173d7dda None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:25.209072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f99ae-9adf-4f5b-91a1-8888173d7dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:25.217634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062ca8-9b83-4ed8-bc18-bbdebf3ad05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:25.218441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062ca8-9b83-4ed8-bc18-bbdebf3ad05e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:25.218721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062ca8-9b83-4ed8-bc18-bbdebf3ad05e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:25.218995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062ca8-9b83-4ed8-bc18-bbdebf3ad05e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:25.232495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce062ca8-9b83-4ed8-bc18-bbdebf3ad05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:25.241915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ce2f99ae-9adf-4f5b-91a1-8888173d7dda None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:25.243125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ce2f99ae-9adf-4f5b-91a1-8888173d7dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-ce062ca8-9b83-4ed8-bc18-bbdebf3ad05e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:25.243329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:25.245379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:25.247347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 186/384] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:25.253296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062ca8-9b83-4ed8-bc18-bbdebf3ad05e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:25.376266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062ca8-9b83-4ed8-bc18-bbdebf3ad05e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:25.415217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:25.415910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:25.416190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:25.416469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:25.417688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] RBAC: Adding query filter params (name=member) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:25.418002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:25.419561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:25.429912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 187/385] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:25.431542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 199/386] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:25.435363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:25.475581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f99ae-9adf-4f5b-91a1-8888173d7dda None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:25.552800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f014df-1411-4b4e-be86-6acf5ea71fff None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:25.595562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee71b06-d3e8-4dea-bcbf-53b12511d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:25.596435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee71b06-d3e8-4dea-bcbf-53b12511d94c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:25.596718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee71b06-d3e8-4dea-bcbf-53b12511d94c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:25.596985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee71b06-d3e8-4dea-bcbf-53b12511d94c None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:25.599367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee71b06-d3e8-4dea-bcbf-53b12511d94c None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:25.600914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee71b06-d3e8-4dea-bcbf-53b12511d94c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:25.603338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 188/387] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:25 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:25.610368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee71b06-d3e8-4dea-bcbf-53b12511d94c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:25.733374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee71b06-d3e8-4dea-bcbf-53b12511d94c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:25.736060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f99ae-9adf-4f5b-91a1-8888173d7dda None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:25.773006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58556357-f8a5-4707-8bf6-5298eb565d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:25.773901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58556357-f8a5-4707-8bf6-5298eb565d8d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:25.774464 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58556357-f8a5-4707-8bf6-5298eb565d8d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:25.774953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58556357-f8a5-4707-8bf6-5298eb565d8d None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:25.776987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58556357-f8a5-4707-8bf6-5298eb565d8d None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:25.779158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58556357-f8a5-4707-8bf6-5298eb565d8d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:25.781828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 189/388] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:25 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:25.789978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58556357-f8a5-4707-8bf6-5298eb565d8d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:25.842954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a076-c41a-49fa-b3d4-10b9244dae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:25.843800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a076-c41a-49fa-b3d4-10b9244dae80 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:25.844084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a076-c41a-49fa-b3d4-10b9244dae80 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:25.844360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a076-c41a-49fa-b3d4-10b9244dae80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:25.875155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8a076-c41a-49fa-b3d4-10b9244dae80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-43e8a076-c41a-49fa-b3d4-10b9244dae80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:25.884325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:25.885305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:25.886138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:25.893363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 200/389] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:41:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:25.895785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a076-c41a-49fa-b3d4-10b9244dae80 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:25.905091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58556357-f8a5-4707-8bf6-5298eb565d8d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:25.949644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8879a-6798-4e0b-ae17-431c5dda36fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:25.950531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8879a-6798-4e0b-ae17-431c5dda36fd None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:25.950814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8879a-6798-4e0b-ae17-431c5dda36fd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:25.951091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8879a-6798-4e0b-ae17-431c5dda36fd None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960/groups/e9749098c50c4f968dda518a09e9f365/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:25.953983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8879a-6798-4e0b-ae17-431c5dda36fd None admin] RBAC: Authorizing `identity:create_grant(project_id=a115aa26e75244d4a57940a1d2497960, group_id=e9749098c50c4f968dda518a09e9f365, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:25.955736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8879a-6798-4e0b-ae17-431c5dda36fd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:26.016165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a076-c41a-49fa-b3d4-10b9244dae80 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:26.059174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:26.060857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.061779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.062397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.063562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:26.064124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:26.065949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:26.080817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 190/390] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 13:41:25 2022] PUT /identity/v3/projects/a115aa26e75244d4a57940a1d2497960/groups/e9749098c50c4f968dda518a09e9f365/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:26.084445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd68a8-2c50-4ce4-bb03-9a99527bcb9f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.085705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd68a8-2c50-4ce4-bb03-9a99527bcb9f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.089272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd68a8-2c50-4ce4-bb03-9a99527bcb9f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.091732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 201/391] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:26.098168 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 191/392] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:26 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:26.101178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:26.110349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f627a2-8dcd-4658-ab4e-5e65934b472b None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.110980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f627a2-8dcd-4658-ab4e-5e65934b472b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.111444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f627a2-8dcd-4658-ab4e-5e65934b472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.149753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-74f627a2-8dcd-4658-ab4e-5e65934b472b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:26.152045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-74f627a2-8dcd-4658-ab4e-5e65934b472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:26.288286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 192/393] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:26.326627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f627a2-8dcd-4658-ab4e-5e65934b472b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:26.344629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d49e7-809d-4ca5-884b-f2ed200eb063 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:26.422542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1029c-b3bc-46ac-92d7-e134df8ea8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:26.423597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1029c-b3bc-46ac-92d7-e134df8ea8d6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.423957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1029c-b3bc-46ac-92d7-e134df8ea8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.424757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1029c-b3bc-46ac-92d7-e134df8ea8d6 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.425966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1029c-b3bc-46ac-92d7-e134df8ea8d6 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:26.427663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1029c-b3bc-46ac-92d7-e134df8ea8d6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:26.430505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 202/394] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:26 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:26.436684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b374-7c43-4364-9fea-38ebf932ca19 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.436684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b374-7c43-4364-9fea-38ebf932ca19 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.436684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b374-7c43-4364-9fea-38ebf932ca19 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.436684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 203/395] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:26.438576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099b374-7c43-4364-9fea-38ebf932ca19 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:26.511268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f627a2-8dcd-4658-ab4e-5e65934b472b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:26.559284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71142b29-d3bf-45a3-a806-d06b51b05dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:26.560072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142b29-d3bf-45a3-a806-d06b51b05dbc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.560358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142b29-d3bf-45a3-a806-d06b51b05dbc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.560628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142b29-d3bf-45a3-a806-d06b51b05dbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.578844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099b374-7c43-4364-9fea-38ebf932ca19 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:26.592823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71142b29-d3bf-45a3-a806-d06b51b05dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-71142b29-d3bf-45a3-a806-d06b51b05dbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:26.601729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:26.603858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 193/396] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:26.605826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0227d-5759-4b02-9c78-0511b12c260c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.607133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0227d-5759-4b02-9c78-0511b12c260c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.607133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0227d-5759-4b02-9c78-0511b12c260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.624412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-75c0227d-5759-4b02-9c78-0511b12c260c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:26.625650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-75c0227d-5759-4b02-9c78-0511b12c260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:26.653928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd76aa-01b6-4ee1-ae52-37ba28631e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:26.654812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd76aa-01b6-4ee1-ae52-37ba28631e3d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.655091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd76aa-01b6-4ee1-ae52-37ba28631e3d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.655360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd76aa-01b6-4ee1-ae52-37ba28631e3d None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.656712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd76aa-01b6-4ee1-ae52-37ba28631e3d None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:26.659078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd76aa-01b6-4ee1-ae52-37ba28631e3d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:26.666379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 204/397] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:26 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:26.667361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd76aa-01b6-4ee1-ae52-37ba28631e3d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:26.774684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 194/398] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:26.776103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0227d-5759-4b02-9c78-0511b12c260c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:26.839056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd76aa-01b6-4ee1-ae52-37ba28631e3d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:26.886149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:26.888300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.888946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.889611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.891048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:26.891650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:26.893915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:26.909627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 205/399] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:26.911358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:26.943602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0227d-5759-4b02-9c78-0511b12c260c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:26.979918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b187-34ea-4e3d-8c9e-68572318fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:26.980802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b187-34ea-4e3d-8c9e-68572318fdee None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:26.981085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b187-34ea-4e3d-8c9e-68572318fdee None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:26.981398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b187-34ea-4e3d-8c9e-68572318fdee None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960/groups/e9749098c50c4f968dda518a09e9f365/roles/597c56383ca9464ca3bf4ae47dbf7716` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:26.983671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b187-34ea-4e3d-8c9e-68572318fdee None admin] RBAC: Authorizing `identity:create_grant(project_id=a115aa26e75244d4a57940a1d2497960, group_id=e9749098c50c4f968dda518a09e9f365, role_id=597c56383ca9464ca3bf4ae47dbf7716)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:26.985118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b187-34ea-4e3d-8c9e-68572318fdee None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:27.021758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db3d04-5f18-4a27-b752-4cf1fea8ce47 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.055109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88acf2-7fdb-4333-991b-48e9d9671e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:27.055912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88acf2-7fdb-4333-991b-48e9d9671e9b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.056187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88acf2-7fdb-4333-991b-48e9d9671e9b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.056459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88acf2-7fdb-4333-991b-48e9d9671e9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.073275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88acf2-7fdb-4333-991b-48e9d9671e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:27.073820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 195/400] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 13:41:26 2022] PUT /identity/v3/projects/a115aa26e75244d4a57940a1d2497960/groups/e9749098c50c4f968dda518a09e9f365/roles/597c56383ca9464ca3bf4ae47dbf7716 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:27.075565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad067-2f07-4a82-9055-b259a85b2930 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.076046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad067-2f07-4a82-9055-b259a85b2930 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.076566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ad067-2f07-4a82-9055-b259a85b2930 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-fd88acf2-7fdb-4333-991b-48e9d9671e9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:27.076684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:27.077704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 206/401] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:41:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:27.079808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88acf2-7fdb-4333-991b-48e9d9671e9b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.083308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 196/402] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:27.090700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ad067-2f07-4a82-9055-b259a85b2930 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.205893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88acf2-7fdb-4333-991b-48e9d9671e9b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.224669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ad067-2f07-4a82-9055-b259a85b2930 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.243829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30878e3-5fc1-4ad4-aaab-7800071a2ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:27.244706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30878e3-5fc1-4ad4-aaab-7800071a2ab7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.244991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30878e3-5fc1-4ad4-aaab-7800071a2ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.245308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30878e3-5fc1-4ad4-aaab-7800071a2ab7 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.246576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30878e3-5fc1-4ad4-aaab-7800071a2ab7 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:27.248054 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30878e3-5fc1-4ad4-aaab-7800071a2ab7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:27.249777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 207/403] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:27 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:27.251164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29002a40-697d-4a40-ac38-89b85ab8cda1 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.251164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29002a40-697d-4a40-ac38-89b85ab8cda1 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.252856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29002a40-697d-4a40-ac38-89b85ab8cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.263935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:27.264794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.265145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.265575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.266467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:27.266890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:27.268436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:27.272788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-29002a40-697d-4a40-ac38-89b85ab8cda1 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:27.274059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-29002a40-697d-4a40-ac38-89b85ab8cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:27.278472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 197/404] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:27.279253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.370696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 208/405] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:27.377442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29002a40-697d-4a40-ac38-89b85ab8cda1 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.413100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855521f3-41e0-4e2e-98f3-0a7519f2078c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.450116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e906a-ed6e-4378-985e-3518647c993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:27.450976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e906a-ed6e-4378-985e-3518647c993e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.451260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e906a-ed6e-4378-985e-3518647c993e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.451538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e906a-ed6e-4378-985e-3518647c993e None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.452866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e906a-ed6e-4378-985e-3518647c993e None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:27.454423 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e906a-ed6e-4378-985e-3518647c993e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:27.456453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 198/406] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:27 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:27.458372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e906a-ed6e-4378-985e-3518647c993e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.515422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29002a40-697d-4a40-ac38-89b85ab8cda1 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.561262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf077-5cae-4b56-aa7e-275b3e56d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:27.562564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf077-5cae-4b56-aa7e-275b3e56d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.562966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf077-5cae-4b56-aa7e-275b3e56d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.563372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbf077-5cae-4b56-aa7e-275b3e56d4e9 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.564786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbf077-5cae-4b56-aa7e-275b3e56d4e9 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:27.567057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbf077-5cae-4b56-aa7e-275b3e56d4e9 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:27.569065 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 209/407] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:27 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:27.574264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf077-5cae-4b56-aa7e-275b3e56d4e9 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.580644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e906a-ed6e-4378-985e-3518647c993e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.623843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94560-0bcf-4365-8731-123415a0453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:27.624707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94560-0bcf-4365-8731-123415a0453c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.624984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94560-0bcf-4365-8731-123415a0453c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.625549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94560-0bcf-4365-8731-123415a0453c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.639022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d94560-0bcf-4365-8731-123415a0453c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-89d94560-0bcf-4365-8731-123415a0453c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:27.649606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:27.650725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:27.651793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:27.656295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 199/408] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:27.657337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94560-0bcf-4365-8731-123415a0453c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.684873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbf077-5cae-4b56-aa7e-275b3e56d4e9 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.724936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc29fb-f1ab-4d79-8db1-76af55d879c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:27.726480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc29fb-f1ab-4d79-8db1-76af55d879c5 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.726936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc29fb-f1ab-4d79-8db1-76af55d879c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.727215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc29fb-f1ab-4d79-8db1-76af55d879c5 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753/groups/e9749098c50c4f968dda518a09e9f365/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.730404 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc29fb-f1ab-4d79-8db1-76af55d879c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=66345118156e4a658492e8c39ca0f753, group_id=e9749098c50c4f968dda518a09e9f365, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:27.732352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc29fb-f1ab-4d79-8db1-76af55d879c5 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:27.780964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94560-0bcf-4365-8731-123415a0453c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.820395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 210/409] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 13:41:27 2022] PUT /identity/v3/projects/66345118156e4a658492e8c39ca0f753/groups/e9749098c50c4f968dda518a09e9f365/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:27.821546 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc29fb-f1ab-4d79-8db1-76af55d879c5 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.822130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2768db-1a3d-470a-bda7-3b73f56bf0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:27.823242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2768db-1a3d-470a-bda7-3b73f56bf0b7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:27.823686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2768db-1a3d-470a-bda7-3b73f56bf0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:27.824142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2768db-1a3d-470a-bda7-3b73f56bf0b7 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:27.825983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2768db-1a3d-470a-bda7-3b73f56bf0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:27.828862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2768db-1a3d-470a-bda7-3b73f56bf0b7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:27.831449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 200/410] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:27 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:27.841908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2768db-1a3d-470a-bda7-3b73f56bf0b7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:27.955343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc29fb-f1ab-4d79-8db1-76af55d879c5 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:27.999715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:28.000403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:28.000687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:28.000963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:28.001763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:28.002072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:28.003480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:28.022523 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 211/411] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:28.036970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:28.062816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2768db-1a3d-470a-bda7-3b73f56bf0b7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:28.111954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a891a-2f2c-4018-bc53-94144f3a1bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:28.113999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a891a-2f2c-4018-bc53-94144f3a1bea None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:28.114290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a891a-2f2c-4018-bc53-94144f3a1bea None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:28.114595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a891a-2f2c-4018-bc53-94144f3a1bea None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753/groups/e9749098c50c4f968dda518a09e9f365/roles/597c56383ca9464ca3bf4ae47dbf7716` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:28.118030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a891a-2f2c-4018-bc53-94144f3a1bea None admin] RBAC: Authorizing `identity:create_grant(project_id=66345118156e4a658492e8c39ca0f753, group_id=e9749098c50c4f968dda518a09e9f365, role_id=597c56383ca9464ca3bf4ae47dbf7716)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:28.119507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a891a-2f2c-4018-bc53-94144f3a1bea None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:28.182881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cfcbf-ccdc-470b-9926-dbd336a82d03 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:28.196619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 201/412] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 13:41:27 2022] PUT /identity/v3/projects/66345118156e4a658492e8c39ca0f753/groups/e9749098c50c4f968dda518a09e9f365/roles/597c56383ca9464ca3bf4ae47dbf7716 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:41:28.239038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b3f9f-c28a-4bdc-8e61-9efdfbbc870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:28.239484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b3f9f-c28a-4bdc-8e61-9efdfbbc870c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:28.239770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b3f9f-c28a-4bdc-8e61-9efdfbbc870c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:28.240115 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b3f9f-c28a-4bdc-8e61-9efdfbbc870c None admin] PATH_INFO: `/v3/groups/950e4c19558c480299d07e289a9eb2c4` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:28.241456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b3f9f-c28a-4bdc-8e61-9efdfbbc870c None admin] RBAC: Authorizing `identity:get_group(group_id=950e4c19558c480299d07e289a9eb2c4)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:28.242968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b3f9f-c28a-4bdc-8e61-9efdfbbc870c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:28.245109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 212/413] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:28 2022] GET /identity/v3/groups/950e4c19558c480299d07e289a9eb2c4 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:28.250853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a891a-2f2c-4018-bc53-94144f3a1bea None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:28.389557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a891a-2f2c-4018-bc53-94144f3a1bea None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:28.433919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2bb41-c288-4dac-81f4-66069ec5bd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:28.434877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2bb41-c288-4dac-81f4-66069ec5bd8e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:28.435158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2bb41-c288-4dac-81f4-66069ec5bd8e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:28.435434 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2bb41-c288-4dac-81f4-66069ec5bd8e None admin] PATH_INFO: `/v3/projects/9c3182e031164ef9b9b514b600f7699c` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:28.436684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2bb41-c288-4dac-81f4-66069ec5bd8e None admin] RBAC: Authorizing `identity:get_project(project_id=9c3182e031164ef9b9b514b600f7699c)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:28.438176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2bb41-c288-4dac-81f4-66069ec5bd8e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:28.440429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 202/414] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:28 2022] GET /identity/v3/projects/9c3182e031164ef9b9b514b600f7699c => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:28.450410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b3f9f-c28a-4bdc-8e61-9efdfbbc870c None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:28.570950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b3f9f-c28a-4bdc-8e61-9efdfbbc870c None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:28.619192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c608a-c28e-42d5-8736-ca034f9d195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:28.620093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c608a-c28e-42d5-8736-ca034f9d195d None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:28.620381 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c608a-c28e-42d5-8736-ca034f9d195d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:28.620663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c608a-c28e-42d5-8736-ca034f9d195d None admin] PATH_INFO: `/v3/projects/9c3182e031164ef9b9b514b600f7699c/groups/950e4c19558c480299d07e289a9eb2c4/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:28.622775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c608a-c28e-42d5-8736-ca034f9d195d None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3182e031164ef9b9b514b600f7699c, group_id=950e4c19558c480299d07e289a9eb2c4, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:28.624316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c608a-c28e-42d5-8736-ca034f9d195d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:28.735707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994d83-681c-439c-a0ff-151e73dee139 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:28.736025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994d83-681c-439c-a0ff-151e73dee139 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:28.736282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b994d83-681c-439c-a0ff-151e73dee139 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:28.738070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 203/415] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:28.754886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c5a3-e021-4f8c-8248-0c28c13b9ce2 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:28.755184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c5a3-e021-4f8c-8248-0c28c13b9ce2 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:28.755701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294c5a3-e021-4f8c-8248-0c28c13b9ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:28.773279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 213/416] 10.222.0.69 () {58 vars in 1442 bytes} [Wed May 4 13:41:28 2022] PUT /identity/v3/projects/9c3182e031164ef9b9b514b600f7699c/groups/950e4c19558c480299d07e289a9eb2c4/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:28.781107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5294c5a3-e021-4f8c-8248-0c28c13b9ce2 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:28.782485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5294c5a3-e021-4f8c-8248-0c28c13b9ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:28.860548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 204/417] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:28.898095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c608a-c28e-42d5-8736-ca034f9d195d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:29.044876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c608a-c28e-42d5-8736-ca034f9d195d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:29.088624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65730e9-144b-474c-8413-ab9c1ed9bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:29.089470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65730e9-144b-474c-8413-ab9c1ed9bd1f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:29.089752 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65730e9-144b-474c-8413-ab9c1ed9bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:29.090032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65730e9-144b-474c-8413-ab9c1ed9bd1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:29.101435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65730e9-144b-474c-8413-ab9c1ed9bd1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-c65730e9-144b-474c-8413-ab9c1ed9bd1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:29.109501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:29.110476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:29.111387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 214/418] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:29.122056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294c5a3-e021-4f8c-8248-0c28c13b9ce2 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:29.235591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294c5a3-e021-4f8c-8248-0c28c13b9ce2 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:29.280590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b354b-76a3-41af-a164-6eac4160e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:29.281308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b354b-76a3-41af-a164-6eac4160e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:29.281597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b354b-76a3-41af-a164-6eac4160e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:29.281874 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b354b-76a3-41af-a164-6eac4160e7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:29.282638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b354b-76a3-41af-a164-6eac4160e7a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:29.282948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b354b-76a3-41af-a164-6eac4160e7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:29.284316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b354b-76a3-41af-a164-6eac4160e7a8 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:29.298108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 205/419] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:29.304150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65730e9-144b-474c-8413-ab9c1ed9bd1f None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:29.451083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65730e9-144b-474c-8413-ab9c1ed9bd1f None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:29.492387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6021e-6e57-4966-bfd5-6d7bf39624ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:29.493044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6021e-6e57-4966-bfd5-6d7bf39624ff None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:29.493394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6021e-6e57-4966-bfd5-6d7bf39624ff None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:29.493670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6021e-6e57-4966-bfd5-6d7bf39624ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:29.573011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6021e-6e57-4966-bfd5-6d7bf39624ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:29.574514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6021e-6e57-4966-bfd5-6d7bf39624ff None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:29.667104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20a4dd-6921-4647-aac2-99b668cd965e None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:29.667433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20a4dd-6921-4647-aac2-99b668cd965e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:29.667679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20a4dd-6921-4647-aac2-99b668cd965e None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:29.669380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 206/420] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:29.674250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36275bf-7a10-419f-967b-6c7667ed483d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:29.674800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36275bf-7a10-419f-967b-6c7667ed483d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:29.675302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36275bf-7a10-419f-967b-6c7667ed483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:29.678051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 215/421] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:29.683288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6021e-6e57-4966-bfd5-6d7bf39624ff None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:29.710131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c36275bf-7a10-419f-967b-6c7667ed483d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:29.711289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c36275bf-7a10-419f-967b-6c7667ed483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:29.784175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6021e-6e57-4966-bfd5-6d7bf39624ff None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:29.824816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 207/422] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:29.828253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952fe84-5fd9-480f-874d-ab6069767268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:29.829144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952fe84-5fd9-480f-874d-ab6069767268 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:29.829455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952fe84-5fd9-480f-874d-ab6069767268 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:29.829737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952fe84-5fd9-480f-874d-ab6069767268 None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:29.831011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952fe84-5fd9-480f-874d-ab6069767268 None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:29.833230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952fe84-5fd9-480f-874d-ab6069767268 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:29.835353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 216/423] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:29 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:29.841133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36275bf-7a10-419f-967b-6c7667ed483d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:29.852190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952fe84-5fd9-480f-874d-ab6069767268 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:30.000972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36275bf-7a10-419f-967b-6c7667ed483d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:30.047501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952fe84-5fd9-480f-874d-ab6069767268 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:30.058925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cd0f0-0a7f-460b-83ac-8f4e2927b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:30.059800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cd0f0-0a7f-460b-83ac-8f4e2927b221 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.060080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cd0f0-0a7f-460b-83ac-8f4e2927b221 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.060356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cd0f0-0a7f-460b-83ac-8f4e2927b221 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.066120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cd0f0-0a7f-460b-83ac-8f4e2927b221 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:30.067840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cd0f0-0a7f-460b-83ac-8f4e2927b221 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:30.073992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 208/424] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:29 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:30.079856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cd0f0-0a7f-460b-83ac-8f4e2927b221 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:30.087246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798db2a1-a99c-4c76-81f4-176c6f73f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:30.088065 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798db2a1-a99c-4c76-81f4-176c6f73f8bc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.088349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798db2a1-a99c-4c76-81f4-176c6f73f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.088625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798db2a1-a99c-4c76-81f4-176c6f73f8bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.109627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798db2a1-a99c-4c76-81f4-176c6f73f8bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-798db2a1-a99c-4c76-81f4-176c6f73f8bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:30.118214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:30.120374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:30.122359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 217/425] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:30.129270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798db2a1-a99c-4c76-81f4-176c6f73f8bc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:30.229963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798db2a1-a99c-4c76-81f4-176c6f73f8bc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:30.265036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:30.265669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.265956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.266240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.267053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:30.267363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:30.273277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:30.277749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 218/426] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:30.283145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:30.288005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cd0f0-0a7f-460b-83ac-8f4e2927b221 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:30.386128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:30.387228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.387717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.388197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.388841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73848486-7375-4bfa-b333-247c49a1a4ea None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:30.389545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] RBAC: Adding query filter params (group.id=e9749098c50c4f968dda518a09e9f365, role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=a115aa26e75244d4a57940a1d2497960) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:30.390104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:30.391820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:30.407581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 209/427] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:30 2022] GET /identity/v3/role_assignments?group.id=e9749098c50c4f968dda518a09e9f365&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=68f91fa718f44020a307be6b2f10b834 => generated 611 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:30.428276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e1253-bdc5-416f-9c6a-6e5f33d4e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:30.428963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1253-bdc5-416f-9c6a-6e5f33d4e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.429285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1253-bdc5-416f-9c6a-6e5f33d4e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.429573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e1253-bdc5-416f-9c6a-6e5f33d4e2c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.504436 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e1253-bdc5-416f-9c6a-6e5f33d4e2c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:30.506077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e1253-bdc5-416f-9c6a-6e5f33d4e2c8 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:30.618765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 219/428] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:41:30.624798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:30.732974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634763-780a-4602-aa4b-99812aa96f55 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.733429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634763-780a-4602-aa4b-99812aa96f55 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.733739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8634763-780a-4602-aa4b-99812aa96f55 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.735374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 220/429] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:30.743763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e3a3-8d8b-4161-9c61-cda1bb03e6ca None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.743763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e3a3-8d8b-4161-9c61-cda1bb03e6ca None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.743763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352e3a3-8d8b-4161-9c61-cda1bb03e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.770456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4352e3a3-8d8b-4161-9c61-cda1bb03e6ca None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:30.772095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4352e3a3-8d8b-4161-9c61-cda1bb03e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:30.780582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68358-8a25-48e0-bb09-8a601a279eb9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:30.819737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ae8d-6694-492e-9726-992f2f5eeb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:30.820075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ae8d-6694-492e-9726-992f2f5eeb7d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.820283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ae8d-6694-492e-9726-992f2f5eeb7d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.820562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ae8d-6694-492e-9726-992f2f5eeb7d None admin] PATH_INFO: `/v3/projects/a115aa26e75244d4a57940a1d2497960` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.822275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40ae8d-6694-492e-9726-992f2f5eeb7d None admin] RBAC: Authorizing `identity:get_project(project_id=a115aa26e75244d4a57940a1d2497960)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:30.823726 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40ae8d-6694-492e-9726-992f2f5eeb7d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:30.826050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 210/430] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:30 2022] GET /identity/v3/projects/a115aa26e75244d4a57940a1d2497960 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:30.832096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ae8d-6694-492e-9726-992f2f5eeb7d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:30.868209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 221/431] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:30.892108 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352e3a3-8d8b-4161-9c61-cda1bb03e6ca None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:30.948710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ae8d-6694-492e-9726-992f2f5eeb7d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:30.984463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b70d1b-3cdc-417a-988a-01f1ce03ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:30.985720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70d1b-3cdc-417a-988a-01f1ce03ca63 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:30.986229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70d1b-3cdc-417a-988a-01f1ce03ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:30.986700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70d1b-3cdc-417a-988a-01f1ce03ca63 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:30.988390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b70d1b-3cdc-417a-988a-01f1ce03ca63 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:30.990376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b70d1b-3cdc-417a-988a-01f1ce03ca63 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:30.992544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 211/432] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:30 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:30.997995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b70d1b-3cdc-417a-988a-01f1ce03ca63 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:31.003189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352e3a3-8d8b-4161-9c61-cda1bb03e6ca None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:31.061302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ecd77-4d64-4884-898c-0d4df1b68a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:31.061302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ecd77-4d64-4884-898c-0d4df1b68a5a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.061302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ecd77-4d64-4884-898c-0d4df1b68a5a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.061302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ecd77-4d64-4884-898c-0d4df1b68a5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.074437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ecd77-4d64-4884-898c-0d4df1b68a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-674ecd77-4d64-4884-898c-0d4df1b68a5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:31.083143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:31.084121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:31.084928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 222/433] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:31.091985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ecd77-4d64-4884-898c-0d4df1b68a5a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:31.138229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b70d1b-3cdc-417a-988a-01f1ce03ca63 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:31.185208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:31.185429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.185645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.185883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.186721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] RBAC: Adding query filter params (group.id=e9749098c50c4f968dda518a09e9f365, role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=a115aa26e75244d4a57940a1d2497960) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:31.187352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:31.188718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:31.198141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 212/434] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:30 2022] GET /identity/v3/role_assignments?group.id=e9749098c50c4f968dda518a09e9f365&scope.project.id=a115aa26e75244d4a57940a1d2497960&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:31.220429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ecd77-4d64-4884-898c-0d4df1b68a5a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:31.275348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4693f7-3c8f-489a-8cd4-7d299cc5a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:31.276101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4693f7-3c8f-489a-8cd4-7d299cc5a97f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.276381 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4693f7-3c8f-489a-8cd4-7d299cc5a97f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.276652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4693f7-3c8f-489a-8cd4-7d299cc5a97f None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.277508 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4693f7-3c8f-489a-8cd4-7d299cc5a97f None admin] RBAC: Adding query filter params (name=member) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:31.277818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4693f7-3c8f-489a-8cd4-7d299cc5a97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:31.279303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4693f7-3c8f-489a-8cd4-7d299cc5a97f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:31.294698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 223/435] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:31.300174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:31.317534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34132-dac9-4365-9876-0d3439cbf07f None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.317889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34132-dac9-4365-9876-0d3439cbf07f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.318088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34132-dac9-4365-9876-0d3439cbf07f None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.319831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 224/436] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:31.327986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcf229-21ce-4c23-8df9-47e2aee30423 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.328339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcf229-21ce-4c23-8df9-47e2aee30423 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.328610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcf229-21ce-4c23-8df9-47e2aee30423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.351630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-f5dcf229-21ce-4c23-8df9-47e2aee30423 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:31.353768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f5dcf229-21ce-4c23-8df9-47e2aee30423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:31.436123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aca16-39a9-43ca-aaf4-f0dc3b23e731 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:31.440990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 225/437] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:31.464799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcf229-21ce-4c23-8df9-47e2aee30423 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:31.476659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1f0a-5e5d-4423-91ac-67555a25f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:31.477711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1f0a-5e5d-4423-91ac-67555a25f647 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.478203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1f0a-5e5d-4423-91ac-67555a25f647 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.478701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb1f0a-5e5d-4423-91ac-67555a25f647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.561499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb1f0a-5e5d-4423-91ac-67555a25f647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:31.563456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb1f0a-5e5d-4423-91ac-67555a25f647 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:31.601747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcf229-21ce-4c23-8df9-47e2aee30423 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:31.646870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1b121-6f45-40a9-841f-0cc67943520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:31.647691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1b121-6f45-40a9-841f-0cc67943520d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.647970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1b121-6f45-40a9-841f-0cc67943520d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.648242 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1b121-6f45-40a9-841f-0cc67943520d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.660520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1b121-6f45-40a9-841f-0cc67943520d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-edb1b121-6f45-40a9-841f-0cc67943520d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:31.668758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:31.669963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:31.671555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 226/438] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:41:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:31.676238 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1b121-6f45-40a9-841f-0cc67943520d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:31.678476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 213/439] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:31.684337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1f0a-5e5d-4423-91ac-67555a25f647 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:31.797974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb1f0a-5e5d-4423-91ac-67555a25f647 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:31.801061 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1b121-6f45-40a9-841f-0cc67943520d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:31.831293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91391ec-f4df-4290-99de-a087f8747743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:31.832199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91391ec-f4df-4290-99de-a087f8747743 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.832485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91391ec-f4df-4290-99de-a087f8747743 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.832759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91391ec-f4df-4290-99de-a087f8747743 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.834009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91391ec-f4df-4290-99de-a087f8747743 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:31.834444 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9c03-6ca2-437b-a190-71a47bf7ca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:31.835132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9c03-6ca2-437b-a190-71a47bf7ca0c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.835417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9c03-6ca2-437b-a190-71a47bf7ca0c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.835539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91391ec-f4df-4290-99de-a087f8747743 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:31.835687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9c03-6ca2-437b-a190-71a47bf7ca0c None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.836429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9c03-6ca2-437b-a190-71a47bf7ca0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:31.836729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9c03-6ca2-437b-a190-71a47bf7ca0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:31.837112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 214/440] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:31 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:31.841648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9c03-6ca2-437b-a190-71a47bf7ca0c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:31.841755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1da9-e888-4181-8316-7de31a40f532 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.841755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1da9-e888-4181-8316-7de31a40f532 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.841755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1da9-e888-4181-8316-7de31a40f532 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.841755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 215/441] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:31.842395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d1da9-e888-4181-8316-7de31a40f532 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:31.855031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 227/442] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:31.855031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade18fb-57df-4050-a469-290476159cfb None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.855031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade18fb-57df-4050-a469-290476159cfb None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.855031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade18fb-57df-4050-a469-290476159cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.868976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3ade18fb-57df-4050-a469-290476159cfb None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:31.870177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3ade18fb-57df-4050-a469-290476159cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:31.935457 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 228/443] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:31.936084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade18fb-57df-4050-a469-290476159cfb None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:31.953572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d1da9-e888-4181-8316-7de31a40f532 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:31.987826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104675-d3f8-4bb8-a122-136bfced0f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:31.988766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104675-d3f8-4bb8-a122-136bfced0f96 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:31.989122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104675-d3f8-4bb8-a122-136bfced0f96 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:31.989426 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73104675-d3f8-4bb8-a122-136bfced0f96 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:31.990604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73104675-d3f8-4bb8-a122-136bfced0f96 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:31.992042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73104675-d3f8-4bb8-a122-136bfced0f96 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:31.993690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 216/444] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:31 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:31.994506 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104675-d3f8-4bb8-a122-136bfced0f96 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:32.040272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade18fb-57df-4050-a469-290476159cfb None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.072179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b7ca-6657-48d7-8c55-d8d2171b8079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.072816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b7ca-6657-48d7-8c55-d8d2171b8079 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.073093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b7ca-6657-48d7-8c55-d8d2171b8079 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.073399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b7ca-6657-48d7-8c55-d8d2171b8079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.090738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73104675-d3f8-4bb8-a122-136bfced0f96 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.124207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8a9d-6dfb-47b7-81c2-8409da446289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.125003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8a9d-6dfb-47b7-81c2-8409da446289 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.125309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8a9d-6dfb-47b7-81c2-8409da446289 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.125587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8a9d-6dfb-47b7-81c2-8409da446289 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.136066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db8a9d-6dfb-47b7-81c2-8409da446289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:32.138404 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b7ca-6657-48d7-8c55-d8d2171b8079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:32.139850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b7ca-6657-48d7-8c55-d8d2171b8079 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-b8db8a9d-6dfb-47b7-81c2-8409da446289 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:32.143539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:32.145034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:32.145856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:32.146462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 217/445] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:32.146959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8a9d-6dfb-47b7-81c2-8409da446289 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:32.234952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 229/446] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:32.235802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b7ca-6657-48d7-8c55-d8d2171b8079 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:32.247081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8a9d-6dfb-47b7-81c2-8409da446289 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.279361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.280012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.280289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.280554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.281592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] RBAC: Adding query filter params (group.id=e9749098c50c4f968dda518a09e9f365, role.id=68f91fa718f44020a307be6b2f10b834, scope.project.id=66345118156e4a658492e8c39ca0f753) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:32.281871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:32.283318 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:32.289934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 218/447] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:32 2022] GET /identity/v3/role_assignments?group.id=e9749098c50c4f968dda518a09e9f365&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=68f91fa718f44020a307be6b2f10b834 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:32.290778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:32.348906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b7ca-6657-48d7-8c55-d8d2171b8079 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.386390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.387078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.387359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.387640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.388415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:32.388724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:32.390160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:32.399924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 230/448] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:32.400593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc9c4-7807-4abd-8546-535281300770 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.405561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:32.437489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa484-5b45-426f-9974-b4504f6d3cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.438849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa484-5b45-426f-9974-b4504f6d3cb8 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.439265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa484-5b45-426f-9974-b4504f6d3cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.439552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa484-5b45-426f-9974-b4504f6d3cb8 None admin] PATH_INFO: `/v3/projects/66345118156e4a658492e8c39ca0f753` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.441540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fa484-5b45-426f-9974-b4504f6d3cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=66345118156e4a658492e8c39ca0f753)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:32.444050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fa484-5b45-426f-9974-b4504f6d3cb8 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:32.446078 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 219/449] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:32 2022] GET /identity/v3/projects/66345118156e4a658492e8c39ca0f753 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:32.451633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa484-5b45-426f-9974-b4504f6d3cb8 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:32.513135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647832a-f89b-4d06-8809-a18f5928cfd4 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.549314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fdb24-e6ce-46e9-8173-551ec88930a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.549904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fdb24-e6ce-46e9-8173-551ec88930a4 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.550185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fdb24-e6ce-46e9-8173-551ec88930a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.550466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fdb24-e6ce-46e9-8173-551ec88930a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.572865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa484-5b45-426f-9974-b4504f6d3cb8 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.613570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61558fb-ba47-4255-9e42-b8fc8cfefd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.614615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61558fb-ba47-4255-9e42-b8fc8cfefd11 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.614904 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61558fb-ba47-4255-9e42-b8fc8cfefd11 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.615180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61558fb-ba47-4255-9e42-b8fc8cfefd11 None admin] PATH_INFO: `/v3/groups/e9749098c50c4f968dda518a09e9f365` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.616422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61558fb-ba47-4255-9e42-b8fc8cfefd11 None admin] RBAC: Authorizing `identity:get_group(group_id=e9749098c50c4f968dda518a09e9f365)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:32.617951 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61558fb-ba47-4255-9e42-b8fc8cfefd11 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:32.619888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 220/450] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:32 2022] GET /identity/v3/groups/e9749098c50c4f968dda518a09e9f365 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:32.625759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61558fb-ba47-4255-9e42-b8fc8cfefd11 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:32.631806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fdb24-e6ce-46e9-8173-551ec88930a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:32.633735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fdb24-e6ce-46e9-8173-551ec88930a4 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:32.737129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61558fb-ba47-4255-9e42-b8fc8cfefd11 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.742027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 231/451] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:41:32.747273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fdb24-e6ce-46e9-8173-551ec88930a4 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:32.771675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.772331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.772620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.772902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.773780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] RBAC: Adding query filter params (group.id=e9749098c50c4f968dda518a09e9f365, role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=66345118156e4a658492e8c39ca0f753) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:32.774097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:32.775570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:32.781460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 221/452] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:32 2022] GET /identity/v3/role_assignments?group.id=e9749098c50c4f968dda518a09e9f365&scope.project.id=66345118156e4a658492e8c39ca0f753&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:32.858690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fdb24-e6ce-46e9-8173-551ec88930a4 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:32.894726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb605c-37f5-4a07-8263-dc26b5023512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:32.896016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb605c-37f5-4a07-8263-dc26b5023512 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:32.896298 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb605c-37f5-4a07-8263-dc26b5023512 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:32.896576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb605c-37f5-4a07-8263-dc26b5023512 None admin] PATH_INFO: `/v3/projects/9c3182e031164ef9b9b514b600f7699c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:32.897891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb605c-37f5-4a07-8263-dc26b5023512 None admin] RBAC: Authorizing `identity:get_project(project_id=9c3182e031164ef9b9b514b600f7699c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:32.899349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb605c-37f5-4a07-8263-dc26b5023512 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:32.901086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 232/453] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:41:32 2022] GET /identity/v3/projects/9c3182e031164ef9b9b514b600f7699c => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:32.906747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:33.011149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310face-4d4b-4091-856e-ca159cf3cc43 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:33.047018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e4a59-90f6-411c-bf5b-a541b3d6829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:33.047879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4a59-90f6-411c-bf5b-a541b3d6829f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:33.048156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4a59-90f6-411c-bf5b-a541b3d6829f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:33.048466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4a59-90f6-411c-bf5b-a541b3d6829f None admin] PATH_INFO: `/v3/groups/950e4c19558c480299d07e289a9eb2c4` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:33.049755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e4a59-90f6-411c-bf5b-a541b3d6829f None admin] RBAC: Authorizing `identity:get_group(group_id=950e4c19558c480299d07e289a9eb2c4)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:33.051618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e4a59-90f6-411c-bf5b-a541b3d6829f None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:33.053291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 222/454] 10.222.0.69 () {56 vars in 1180 bytes} [Wed May 4 13:41:32 2022] GET /identity/v3/groups/950e4c19558c480299d07e289a9eb2c4 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:33.059156 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb605c-37f5-4a07-8263-dc26b5023512 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:33.165136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb605c-37f5-4a07-8263-dc26b5023512 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:33.198297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7872b-ac44-4531-806b-f6808d5d07c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:33.198944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7872b-ac44-4531-806b-f6808d5d07c3 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:33.199227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7872b-ac44-4531-806b-f6808d5d07c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:33.199500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7872b-ac44-4531-806b-f6808d5d07c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:33.200332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7872b-ac44-4531-806b-f6808d5d07c3 None admin] RBAC: Adding query filter params (group.id=950e4c19558c480299d07e289a9eb2c4, role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=9c3182e031164ef9b9b514b600f7699c) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:33.200643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7872b-ac44-4531-806b-f6808d5d07c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:33.202103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7872b-ac44-4531-806b-f6808d5d07c3 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:33.208737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 233/455] 10.222.0.69 () {56 vars in 1376 bytes} [Wed May 4 13:41:33 2022] GET /identity/v3/role_assignments?group.id=950e4c19558c480299d07e289a9eb2c4&scope.project.id=9c3182e031164ef9b9b514b600f7699c&role.id=f1d6bdc882c24a2a9389961135865317 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:36.018244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e077f2-ab38-49ed-aaa4-38f4a33d6adb None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.019806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e077f2-ab38-49ed-aaa4-38f4a33d6adb None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.020473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e077f2-ab38-49ed-aaa4-38f4a33d6adb None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.022601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 223/456] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:36.027990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f516c-e2a2-4c0e-81b4-d3c8e0bc0664 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.028977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f516c-e2a2-4c0e-81b4-d3c8e0bc0664 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.029510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f516c-e2a2-4c0e-81b4-d3c8e0bc0664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.058492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-cf6f516c-e2a2-4c0e-81b4-d3c8e0bc0664 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:36.060078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-cf6f516c-e2a2-4c0e-81b4-d3c8e0bc0664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:36.146353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 234/457] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:36.190258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e077f2-ab38-49ed-aaa4-38f4a33d6adb None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:36.249406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118f7cb-f61d-444e-9b7a-691b4d876f35 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.250047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118f7cb-f61d-444e-9b7a-691b4d876f35 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.250527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118f7cb-f61d-444e-9b7a-691b4d876f35 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.252154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 235/458] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:36.258367 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8764d-c634-4b63-9eda-28fffc196cae None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.258982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8764d-c634-4b63-9eda-28fffc196cae None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.259700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8764d-c634-4b63-9eda-28fffc196cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.293574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1cb8764d-c634-4b63-9eda-28fffc196cae None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:36.295096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1cb8764d-c634-4b63-9eda-28fffc196cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:36.317414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e077f2-ab38-49ed-aaa4-38f4a33d6adb None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:36.370688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2eec4-3741-4e84-bdf4-b6810d95215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:36.371488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2eec4-3741-4e84-bdf4-b6810d95215a None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.371773 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2eec4-3741-4e84-bdf4-b6810d95215a None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.372045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2eec4-3741-4e84-bdf4-b6810d95215a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.393717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2eec4-3741-4e84-bdf4-b6810d95215a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:36.395376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2eec4-3741-4e84-bdf4-b6810d95215a None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-21e2eec4-3741-4e84-bdf4-b6810d95215a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:36.426499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:36.427586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:36.428621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:36.428621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:36.428621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:36.428621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:36.432323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 224/459] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:36.432323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce9f0-f357-4d5f-9bda-f1ccc547387f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.432323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce9f0-f357-4d5f-9bda-f1ccc547387f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.432323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce9f0-f357-4d5f-9bda-f1ccc547387f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.432323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 225/460] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:36.436386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce9f0-f357-4d5f-9bda-f1ccc547387f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:36.437983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 236/461] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:36.439570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1330864-0251-43b5-9eed-c76b4baed295 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.440096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1330864-0251-43b5-9eed-c76b4baed295 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.440594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1330864-0251-43b5-9eed-c76b4baed295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.459521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e1330864-0251-43b5-9eed-c76b4baed295 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:36.461042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e1330864-0251-43b5-9eed-c76b4baed295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:36.555438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 237/462] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:36.557335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1330864-0251-43b5-9eed-c76b4baed295 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:36.559643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce9f0-f357-4d5f-9bda-f1ccc547387f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:36.601788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:36.602816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.603303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.603777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.604974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:36.605482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:36.607077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:36.620593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 226/463] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:36.621735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:36.674082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1330864-0251-43b5-9eed-c76b4baed295 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:36.711370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:36.712166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.712449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.712725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.723677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:36.725135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:36.729060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49bb58-5a2c-4ca8-80ef-c16f662aefe6 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:36.744739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:36.746181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:36.747211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:36.747211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:36.747211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:36.747211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:36.747211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 238/464] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:36.747211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:36.775364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1442fd-2152-4fac-9e97-ee472a98ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:36.776165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1442fd-2152-4fac-9e97-ee472a98ea29 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.776451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1442fd-2152-4fac-9e97-ee472a98ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.776978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1442fd-2152-4fac-9e97-ee472a98ea29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.787940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1442fd-2152-4fac-9e97-ee472a98ea29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:36.789441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1442fd-2152-4fac-9e97-ee472a98ea29 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-0f1442fd-2152-4fac-9e97-ee472a98ea29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:36.808294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:36.809399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:36.810263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:36.810263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:36.810263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:36.810263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:36.810263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 227/465] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:36.810985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fd66-fc6b-4acf-b03a-e2189e95077f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.811267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fd66-fc6b-4acf-b03a-e2189e95077f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.811544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fd66-fc6b-4acf-b03a-e2189e95077f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.812937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 228/466] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:36.819894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199fd66-fc6b-4acf-b03a-e2189e95077f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:36.859111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db9ac3-e1e0-490a-b1ad-54d2469ac4ce None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:36.895183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a427d-e15e-4aca-94aa-ab5fd2ad1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:36.895941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a427d-e15e-4aca-94aa-ab5fd2ad1c96 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.896225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a427d-e15e-4aca-94aa-ab5fd2ad1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.896502 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a427d-e15e-4aca-94aa-ab5fd2ad1c96 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.897217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a427d-e15e-4aca-94aa-ab5fd2ad1c96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:36.898723 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a427d-e15e-4aca-94aa-ab5fd2ad1c96 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:36.924679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199fd66-fc6b-4acf-b03a-e2189e95077f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:36.958956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4542-eef1-46ee-8d11-5af18475dd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:36.959810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4542-eef1-46ee-8d11-5af18475dd0c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.960180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4542-eef1-46ee-8d11-5af18475dd0c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.960624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4542-eef1-46ee-8d11-5af18475dd0c None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:36.961498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4542-eef1-46ee-8d11-5af18475dd0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:36.961905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4542-eef1-46ee-8d11-5af18475dd0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:36.964121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4542-eef1-46ee-8d11-5af18475dd0c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:36.976028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 239/467] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:41:36 2022] POST /identity/v3/users => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:36.979087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a427d-e15e-4aca-94aa-ab5fd2ad1c96 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:36.991106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 229/468] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:36.992828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2284-9424-4520-9c8c-c1d4f53f5818 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:36.993147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2284-9424-4520-9c8c-c1d4f53f5818 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:36.993786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2284-9424-4520-9c8c-c1d4f53f5818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.016954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d67f2284-9424-4520-9c8c-c1d4f53f5818 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:37.018490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d67f2284-9424-4520-9c8c-c1d4f53f5818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:37.096228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 230/469] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:37.097672 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f2284-9424-4520-9c8c-c1d4f53f5818 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:37.107701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a427d-e15e-4aca-94aa-ab5fd2ad1c96 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:37.145675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:37.146679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.147098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.147595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.148547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:37.149078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:37.150772 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:37.165025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 240/470] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:37.170741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:37.208640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f2284-9424-4520-9c8c-c1d4f53f5818 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:37.254543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aa50d-932c-4a1f-8de4-97c0fdbe77a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:37.255219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aa50d-932c-4a1f-8de4-97c0fdbe77a1 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.255504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aa50d-932c-4a1f-8de4-97c0fdbe77a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.255778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185aa50d-932c-4a1f-8de4-97c0fdbe77a1 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.256491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185aa50d-932c-4a1f-8de4-97c0fdbe77a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:37.257990 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185aa50d-932c-4a1f-8de4-97c0fdbe77a1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:37.302886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc92f1-b3d5-41d6-bfc6-119f68602315 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:37.338925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:37.339729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.340013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.340287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.350905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:37.352317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:37.373255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:37.374244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:37.375128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:37.375128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:37.375128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:37.375128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:37.375919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 241/471] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:37.381591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 231/472] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:41:37 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:37.381744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:37.383353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aa50d-932c-4a1f-8de4-97c0fdbe77a1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:37.531199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e29d2-ceb2-4398-9e11-66577cc378b0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:37.556211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185aa50d-932c-4a1f-8de4-97c0fdbe77a1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:37.569090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621b83-c428-4ea4-b68f-f2de4b131827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:37.569817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621b83-c428-4ea4-b68f-f2de4b131827 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.570107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621b83-c428-4ea4-b68f-f2de4b131827 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.570610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621b83-c428-4ea4-b68f-f2de4b131827 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.571083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a621b83-c428-4ea4-b68f-f2de4b131827 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:37.572563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a621b83-c428-4ea4-b68f-f2de4b131827 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:37.596107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053f62e-47bb-4e7d-b4d4-9c7686400ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:37.597604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f62e-47bb-4e7d-b4d4-9c7686400ce6 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.597813 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f62e-47bb-4e7d-b4d4-9c7686400ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.598150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053f62e-47bb-4e7d-b4d4-9c7686400ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.598901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053f62e-47bb-4e7d-b4d4-9c7686400ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:37.599209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053f62e-47bb-4e7d-b4d4-9c7686400ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:37.600649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053f62e-47bb-4e7d-b4d4-9c7686400ce6 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:37.613720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 232/473] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:37.618789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49585ca5-50b7-4bb8-884e-35f9a82b017b None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.619080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49585ca5-50b7-4bb8-884e-35f9a82b017b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.619383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49585ca5-50b7-4bb8-884e-35f9a82b017b None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.621103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 233/474] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:37.621741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49585ca5-50b7-4bb8-884e-35f9a82b017b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:37.667519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 242/475] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:41:37 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:37.668871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc76df-dd28-4a71-949d-d6adccc8ed36 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.669158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc76df-dd28-4a71-949d-d6adccc8ed36 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.669483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc76df-dd28-4a71-949d-d6adccc8ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.687531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-07fc76df-dd28-4a71-949d-d6adccc8ed36 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:37.688734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-07fc76df-dd28-4a71-949d-d6adccc8ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:37.768209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49585ca5-50b7-4bb8-884e-35f9a82b017b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:37.790899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 243/476] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:37.808551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad9f05-3cec-4ddd-b210-0c127aa452ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:37.809255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9f05-3cec-4ddd-b210-0c127aa452ee None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.809553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9f05-3cec-4ddd-b210-0c127aa452ee None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.809835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9f05-3cec-4ddd-b210-0c127aa452ee None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.810555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad9f05-3cec-4ddd-b210-0c127aa452ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:37.812057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad9f05-3cec-4ddd-b210-0c127aa452ee None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:37.826984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc76df-dd28-4a71-949d-d6adccc8ed36 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:37.893395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 234/477] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:41:37 2022] POST /identity/v3/users => generated 249 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:37.956841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc76df-dd28-4a71-949d-d6adccc8ed36 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:37.998790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:37.999481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.999764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:38.000039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:38.000806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:38.002249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:38.041647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.sql.core [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 13:41:38.041647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 13:41:38.041647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [parameters: {'id': 'f081b1f8e2b44ad1bb824b7b4530e9fb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 13:41:38.041647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91848) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application conn.query(q) May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result.read() May 04 13:41:38.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return ref.to_dict() May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:41:38.061881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application next(self.gen) May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application yield resource May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application next(self.gen) May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.session.rollback() May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.force_reraise() May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise self.value May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application session.commit() May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 13:41:38.063910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._prepare_impl() May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.session.flush() May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._flush(objects) May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application compat.raise_( May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application flush_context.execute() May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rec.execute(self) May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 13:41:38.066619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:41:38.073713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application conn.query(q) May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result.read() May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:41:38.075806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [parameters: {'id': 'f081b1f8e2b44ad1bb824b7b4530e9fb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:38.077904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 13:41:38.079945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:38.082066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 244/478] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 13:41:37 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:38.082202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad9f05-3cec-4ddd-b210-0c127aa452ee None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:38.178162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad9f05-3cec-4ddd-b210-0c127aa452ee None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:38.215094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118ab55-2b98-4a2c-bae5-b67858d1730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:38.215910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ab55-2b98-4a2c-bae5-b67858d1730c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:38.216200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ab55-2b98-4a2c-bae5-b67858d1730c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:38.216481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118ab55-2b98-4a2c-bae5-b67858d1730c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:38.227708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118ab55-2b98-4a2c-bae5-b67858d1730c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e118ab55-2b98-4a2c-bae5-b67858d1730c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:38.236032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:38.238774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:41:38.240702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:38.243273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 235/479] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:41:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:38.244463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:38.353055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3af6-3483-49cb-b155-a38ea03a2695 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:38.388026 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9685-d2bb-4f74-bd5a-7e2e364f7e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:38.388699 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9685-d2bb-4f74-bd5a-7e2e364f7e4f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:38.388984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9685-d2bb-4f74-bd5a-7e2e364f7e4f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:38.389282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9685-d2bb-4f74-bd5a-7e2e364f7e4f None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:38.390045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca9685-d2bb-4f74-bd5a-7e2e364f7e4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:38.390355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca9685-d2bb-4f74-bd5a-7e2e364f7e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:38.391729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca9685-d2bb-4f74-bd5a-7e2e364f7e4f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:38.404190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 245/480] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:39.618856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fdae-b694-4537-bc45-fc7179b4b48b None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:39.619373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fdae-b694-4537-bc45-fc7179b4b48b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:39.619447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fdae-b694-4537-bc45-fc7179b4b48b None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:39.621038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 236/481] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:39.626287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11d35-6d9f-4806-9194-dea6e59ebfda None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:39.626723 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11d35-6d9f-4806-9194-dea6e59ebfda None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:39.626902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11d35-6d9f-4806-9194-dea6e59ebfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:39.645738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3fd11d35-6d9f-4806-9194-dea6e59ebfda None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:39.646946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3fd11d35-6d9f-4806-9194-dea6e59ebfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:39.719942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 246/482] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:39.744774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fdae-b694-4537-bc45-fc7179b4b48b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:39.858336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fdae-b694-4537-bc45-fc7179b4b48b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:39.898749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495e51-36e3-460d-8ca4-e05da795667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:39.899472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495e51-36e3-460d-8ca4-e05da795667f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:39.899753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495e51-36e3-460d-8ca4-e05da795667f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:39.900029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495e51-36e3-460d-8ca4-e05da795667f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:39.912547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba495e51-36e3-460d-8ca4-e05da795667f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-ba495e51-36e3-460d-8ca4-e05da795667f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:39.920446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:39.921376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:39.922163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 237/483] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:39.928281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd11d35-6d9f-4806-9194-dea6e59ebfda None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:40.036935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd11d35-6d9f-4806-9194-dea6e59ebfda None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:40.073282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21a864-2854-4306-b214-393ced951500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:40.073975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21a864-2854-4306-b214-393ced951500 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.074257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21a864-2854-4306-b214-393ced951500 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.074534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21a864-2854-4306-b214-393ced951500 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.075297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21a864-2854-4306-b214-393ced951500 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:40.075604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21a864-2854-4306-b214-393ced951500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:40.076998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21a864-2854-4306-b214-393ced951500 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:40.087560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 247/484] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:40.094551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495e51-36e3-460d-8ca4-e05da795667f None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:40.210857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495e51-36e3-460d-8ca4-e05da795667f None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:40.253504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1470f0-ece0-4f19-8b55-e914a78c4aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:40.255082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1470f0-ece0-4f19-8b55-e914a78c4aff None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.255570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1470f0-ece0-4f19-8b55-e914a78c4aff None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.256066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1470f0-ece0-4f19-8b55-e914a78c4aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.268742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1470f0-ece0-4f19-8b55-e914a78c4aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:40.271581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1470f0-ece0-4f19-8b55-e914a78c4aff None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-7e1470f0-ece0-4f19-8b55-e914a78c4aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:40.292166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:40.293086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:40.293957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:40.293957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:40.293957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:40.293957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:40.296022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 238/485] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:40.302109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21a864-2854-4306-b214-393ced951500 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:40.412922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21a864-2854-4306-b214-393ced951500 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:40.428022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9176c-7417-4700-bdfa-b6a4dc4ef0ec None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.428539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9176c-7417-4700-bdfa-b6a4dc4ef0ec None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.429010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9176c-7417-4700-bdfa-b6a4dc4ef0ec None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.430583 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 239/486] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:40.435953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c973fe-b503-4d40-9ed0-b7dbbf78dbbf None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.436229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c973fe-b503-4d40-9ed0-b7dbbf78dbbf None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.436506 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c973fe-b503-4d40-9ed0-b7dbbf78dbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.458726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:40.459734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.460158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.460624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.461584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:40.462035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:40.463860 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:40.474531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-76c973fe-b503-4d40-9ed0-b7dbbf78dbbf None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:40.475688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-76c973fe-b503-4d40-9ed0-b7dbbf78dbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:40.478503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 248/487] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:40.485272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:40.601702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78223-ade3-4aee-8cbf-9fb47b5ed4cb None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:40.639942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:40.641546 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.641984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.642405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.652288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 240/488] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:40.653300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:40.654918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:40.673223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:40.674427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:41:40.675742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:40.678761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 249/489] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:41:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:40.684538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c973fe-b503-4d40-9ed0-b7dbbf78dbbf None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:40.688760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:40.824540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c973fe-b503-4d40-9ed0-b7dbbf78dbbf None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:40.878425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee474d-9750-4149-af32-15135513c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:40.879954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee474d-9750-4149-af32-15135513c483 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.880658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee474d-9750-4149-af32-15135513c483 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.881339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee474d-9750-4149-af32-15135513c483 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.883997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee474d-9750-4149-af32-15135513c483 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:40.884960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee474d-9750-4149-af32-15135513c483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:40.887864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee474d-9750-4149-af32-15135513c483 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:40.959295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee777b-cfdc-4119-b833-247c190a3d22 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:40.981634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 241/490] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:41:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:40.982823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3efc9-8f11-4b53-8438-04b7e13d27b4 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.983116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3efc9-8f11-4b53-8438-04b7e13d27b4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.983399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3efc9-8f11-4b53-8438-04b7e13d27b4 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.984712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 242/491] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:40.991179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3efc9-8f11-4b53-8438-04b7e13d27b4 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.009990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2c92-7b09-423e-8078-1388252dfc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.010717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2c92-7b09-423e-8078-1388252dfc4b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.010998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2c92-7b09-423e-8078-1388252dfc4b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.011272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2c92-7b09-423e-8078-1388252dfc4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.023089 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e2c92-7b09-423e-8078-1388252dfc4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-9f9e2c92-7b09-423e-8078-1388252dfc4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:41.031047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:41.032127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:41.032905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 250/492] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:41.038553 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea4e68-87cb-411f-97c6-132d1dc9f07b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.039651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea4e68-87cb-411f-97c6-132d1dc9f07b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.039936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea4e68-87cb-411f-97c6-132d1dc9f07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.067149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-43ea4e68-87cb-411f-97c6-132d1dc9f07b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:41.069306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-43ea4e68-87cb-411f-97c6-132d1dc9f07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:41.119879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3efc9-8f11-4b53-8438-04b7e13d27b4 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.157265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 251/493] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:41.157265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea4e68-87cb-411f-97c6-132d1dc9f07b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.167923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e1c8-0eba-42e6-a771-3832ef6288cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.168907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e1c8-0eba-42e6-a771-3832ef6288cf None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.173526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e1c8-0eba-42e6-a771-3832ef6288cf None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.174129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e1c8-0eba-42e6-a771-3832ef6288cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.256306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea4e68-87cb-411f-97c6-132d1dc9f07b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.264641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429e1c8-0eba-42e6-a771-3832ef6288cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:41.266499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429e1c8-0eba-42e6-a771-3832ef6288cf None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:41.292327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.293286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.293286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.293579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.294354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:41.294652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:41.296013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:41.309402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 252/494] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:41.309402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.390593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 243/495] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:41.392486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e1c8-0eba-42e6-a771-3832ef6288cf None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.429689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893ab2b-1426-4c83-931f-de2451bc3d05 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.465013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7cc73-762d-4b45-81dd-08798fcde300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.465846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7cc73-762d-4b45-81dd-08798fcde300 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.466121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7cc73-762d-4b45-81dd-08798fcde300 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.466394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7cc73-762d-4b45-81dd-08798fcde300 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.477506 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7cc73-762d-4b45-81dd-08798fcde300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-3cd7cc73-762d-4b45-81dd-08798fcde300 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:41.485478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:41.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:41.487249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 253/496] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:41.488581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7cc73-762d-4b45-81dd-08798fcde300 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.499381 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e1c8-0eba-42e6-a771-3832ef6288cf None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.539730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908a65e-ae91-4065-b325-35fad88b0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.540442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908a65e-ae91-4065-b325-35fad88b0e52 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.540734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908a65e-ae91-4065-b325-35fad88b0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.541011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908a65e-ae91-4065-b325-35fad88b0e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.552864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908a65e-ae91-4065-b325-35fad88b0e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:41.554356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908a65e-ae91-4065-b325-35fad88b0e52 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-8908a65e-ae91-4065-b325-35fad88b0e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:41.572662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:41.573620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:41.574484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:41.574484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:41.574484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:41.574484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:41.574484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 244/497] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:41.575230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b81d-c493-443c-8008-99c50cba1efc None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.575517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b81d-c493-443c-8008-99c50cba1efc None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.575794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b81d-c493-443c-8008-99c50cba1efc None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.577890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 245/498] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:41.577890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15b81d-c493-443c-8008-99c50cba1efc None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.608533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7cc73-762d-4b45-81dd-08798fcde300 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.641089 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae568c0b-7dcc-410e-8a6e-e56dffe35778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.641911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae568c0b-7dcc-410e-8a6e-e56dffe35778 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.642190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae568c0b-7dcc-410e-8a6e-e56dffe35778 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.642461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae568c0b-7dcc-410e-8a6e-e56dffe35778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.653664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae568c0b-7dcc-410e-8a6e-e56dffe35778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:41.655134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae568c0b-7dcc-410e-8a6e-e56dffe35778 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-ae568c0b-7dcc-410e-8a6e-e56dffe35778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:41.672976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:41.673963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:41.676568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:41.676568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:41.676568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:41.676568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:41.676568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 254/499] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:41.676568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01071c8c-e763-4108-97f8-96a70e76124e None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.676568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01071c8c-e763-4108-97f8-96a70e76124e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.676962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01071c8c-e763-4108-97f8-96a70e76124e None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.678097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 255/500] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:41.678628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01071c8c-e763-4108-97f8-96a70e76124e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.682456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15b81d-c493-443c-8008-99c50cba1efc None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.717495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93313442-ca3c-4913-80a1-badc01c9aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.718158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93313442-ca3c-4913-80a1-badc01c9aca2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.718439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93313442-ca3c-4913-80a1-badc01c9aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.718713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93313442-ca3c-4913-80a1-badc01c9aca2 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.719460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93313442-ca3c-4913-80a1-badc01c9aca2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:41.719768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93313442-ca3c-4913-80a1-badc01c9aca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:41.721157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93313442-ca3c-4913-80a1-badc01c9aca2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:41.730538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 246/501] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:41.731766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763151-40c2-45d2-b1fc-47c01dd3af81 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.732056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763151-40c2-45d2-b1fc-47c01dd3af81 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.732335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5763151-40c2-45d2-b1fc-47c01dd3af81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.748481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d5763151-40c2-45d2-b1fc-47c01dd3af81 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:41.749697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d5763151-40c2-45d2-b1fc-47c01dd3af81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:41.786921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01071c8c-e763-4108-97f8-96a70e76124e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.829345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 247/502] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:41.829345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5763151-40c2-45d2-b1fc-47c01dd3af81 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.829603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e43bae-493d-4b3b-9c7f-b7becc295d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.829603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43bae-493d-4b3b-9c7f-b7becc295d1a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.829603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43bae-493d-4b3b-9c7f-b7becc295d1a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.829603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e43bae-493d-4b3b-9c7f-b7becc295d1a None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.829893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e43bae-493d-4b3b-9c7f-b7becc295d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:41.829893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e43bae-493d-4b3b-9c7f-b7becc295d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:41.829893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e43bae-493d-4b3b-9c7f-b7becc295d1a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:41.844427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 256/503] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:41.844427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619988-0b1b-42c0-ac74-31e255c7226f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.844427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619988-0b1b-42c0-ac74-31e255c7226f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.844427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619988-0b1b-42c0-ac74-31e255c7226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.860022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-06619988-0b1b-42c0-ac74-31e255c7226f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:41.861324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-06619988-0b1b-42c0-ac74-31e255c7226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:41.927475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 257/504] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:41.928330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06619988-0b1b-42c0-ac74-31e255c7226f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.942977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5763151-40c2-45d2-b1fc-47c01dd3af81 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.978386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.979056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.979338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.979607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.980584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:41.980887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:41.982289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:41.993679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 248/505] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:41.994481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.025378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06619988-0b1b-42c0-ac74-31e255c7226f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.058352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.059140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.059423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.059694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.070225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.071682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:42.089911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:42.090972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:42.092013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:42.092013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:42.092013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:42.092013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:42.092013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 258/506] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:42.092306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.098353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3c43-b0f9-45e5-a1d6-93daad2c64b1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.130995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a031ff-0150-4a12-a38f-7ca39c1fd5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.131785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a031ff-0150-4a12-a38f-7ca39c1fd5d5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.132064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a031ff-0150-4a12-a38f-7ca39c1fd5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.132335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a031ff-0150-4a12-a38f-7ca39c1fd5d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.143152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a031ff-0150-4a12-a38f-7ca39c1fd5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-72a031ff-0150-4a12-a38f-7ca39c1fd5d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:42.151528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:42.152609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 249/507] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:42.158268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a031ff-0150-4a12-a38f-7ca39c1fd5d5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.193633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbc06-abd8-468a-a2ee-1d840d408003 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.228259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.229075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.229344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.229616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.236747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.238992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:42.252945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:42.254386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 259/508] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:42.259918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.260541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a031ff-0150-4a12-a38f-7ca39c1fd5d5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.294630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.295419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.295723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.296002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.307178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.308619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:42.325541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:42.326416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:42.327607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:42.327607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:42.327607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:42.327607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:42.327607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 250/509] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:42.328031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.353173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f01c4-7ba5-45ae-b80a-6c5202a1a370 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.387180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.387957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.388231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.388498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.395499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.396928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:42.411823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:42.412780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:42.413676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 260/510] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:42.414134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.428744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e02ff-d291-4c28-bbc6-cab371ecb885 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.461892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.462541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.462820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.463092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.463812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:42.464113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.465493 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.478213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 251/511] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:42.479303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.513312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77535083-abb6-46c7-86a4-93a15e15532e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.547199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.547850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.548133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.548409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.549164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:42.549500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.551038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.559031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 261/512] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:42.559834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.581087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2e98d-e043-4218-bd67-a9f86b9905fe None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.615222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.615805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.616083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.616353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.617185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:42.617517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.618956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.635833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 252/513] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:42.636653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.662644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb260d-a006-4334-bf8e-cb98dad5a289 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.696465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.697179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.697524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.697801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.698556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:42.698867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.700237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.712590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 262/514] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:42.713466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.735465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ddfd9-0540-4f8b-9a15-003f34627413 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.769573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.770320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.770520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.770795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.771591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:42.771899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.773362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.791573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 253/515] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:42.792395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.811800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253fe8e-5126-42c7-8f87-c2d638281a9a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.845249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.846058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.846335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.846603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] PATH_INFO: `/v3/users/glance` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.854159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.855869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:42.870517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:42.871424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:42.872317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 263/516] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:42.872882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.890917 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c140d08-1991-4153-bbe9-f6f509396187 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:42.923963 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90125579-3af1-4535-af05-794e96930b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:42.924749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125579-3af1-4535-af05-794e96930b5e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:42.925033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125579-3af1-4535-af05-794e96930b5e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:42.925404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125579-3af1-4535-af05-794e96930b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:42.935201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90125579-3af1-4535-af05-794e96930b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:42.936652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90125579-3af1-4535-af05-794e96930b5e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-90125579-3af1-4535-af05-794e96930b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:42.954205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:42.955092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:42.955987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:42.955987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:42.955987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:42.955987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:42.955987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 254/517] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:42.956255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90125579-3af1-4535-af05-794e96930b5e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:42.974936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1879ad0-c819-4e44-895f-ad3882ea235a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.008206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8b884-4e09-4d57-ad81-1034d5efa07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.008851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b884-4e09-4d57-ad81-1034d5efa07a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.009136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b884-4e09-4d57-ad81-1034d5efa07a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.009469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b884-4e09-4d57-ad81-1034d5efa07a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90125579-3af1-4535-af05-794e96930b5e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.074636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8b884-4e09-4d57-ad81-1034d5efa07a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.076098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8b884-4e09-4d57-ad81-1034d5efa07a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.083820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c889ecc-d8e0-4579-aef5-a6f68835fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.084473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c889ecc-d8e0-4579-aef5-a6f68835fffd None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.084752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c889ecc-d8e0-4579-aef5-a6f68835fffd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.085022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c889ecc-d8e0-4579-aef5-a6f68835fffd None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.085742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c889ecc-d8e0-4579-aef5-a6f68835fffd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.087166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c889ecc-d8e0-4579-aef5-a6f68835fffd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.172069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 264/518] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:43.172838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8b884-4e09-4d57-ad81-1034d5efa07a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.189772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 255/519] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:41:42 2022] POST /identity/v3/users => generated 247 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:41:43.190553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c889ecc-d8e0-4579-aef5-a6f68835fffd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.281936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8b884-4e09-4d57-ad81-1034d5efa07a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.301814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c889ecc-d8e0-4579-aef5-a6f68835fffd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.319092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.320107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.320394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.320675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.321578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=f6da21ec482e47399411baa3c33f4f21) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:43.321898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.323378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.329617 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 265/520] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/role_assignments?user.id=f6da21ec482e47399411baa3c33f4f21&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:43.330912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.339303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.340069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.340357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.340688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.341660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:43.341984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.343639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.365726 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 256/521] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:43.367129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.464832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967dcc-2d08-4844-b3f5-3e3e400146fd None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.480076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbd8f7-91f2-4bb8-9489-1a2fc1911245 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.506679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.507423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.507710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.507988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.508738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:43.509044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.510512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.518066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.519639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.520014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.520380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.525189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 266/522] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:43.526104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.534406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.537271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:43.561451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:43.562368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:43.563192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:43.563192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:43.563192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:43.563192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:43.563192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 257/523] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:43.564172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.641595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d085f4-0384-4fa8-971c-34b6a096bf1a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.669815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b5b24-f416-421b-b62f-009b1d8f29e6 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.678448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eab02-a5ec-431c-bf3e-b18d13bcf45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.679797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eab02-a5ec-431c-bf3e-b18d13bcf45e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.680317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eab02-a5ec-431c-bf3e-b18d13bcf45e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.680782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eab02-a5ec-431c-bf3e-b18d13bcf45e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.706278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.707459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.707739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.708101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.716592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.718010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:43.734490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:43.735442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 258/524] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:43.737774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.767150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eab02-a5ec-431c-bf3e-b18d13bcf45e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.769087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eab02-a5ec-431c-bf3e-b18d13bcf45e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.856296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14870-cf86-47bb-82dc-43a8af154b58 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.878554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 267/525] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:43.880079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eab02-a5ec-431c-bf3e-b18d13bcf45e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.891981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.892653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.892939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.893216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.894035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:43.894352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.895798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.908140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 259/526] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:43.909012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.986408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eab02-a5ec-431c-bf3e-b18d13bcf45e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.010099 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137360c-5048-4346-82b2-3ba5722236bb None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.022125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.023111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.023587 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.024087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.025123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:44.025687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.027323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.047658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.048485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.048808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.049025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.061073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.062590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.071307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 268/527] 10.222.0.69 () {56 vars in 1139 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:44.072434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:44.082023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:44.083137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:44.084215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:44.084215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:44.084215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:44.084215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:44.084215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 260/528] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:44.084473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.176232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67fbd4-6c7a-4e76-a6ab-4691ac233a2a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.208527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913d93-1e02-42ca-a082-42eae8dab4a5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.212867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.213882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.214298 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.214736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.222311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.223782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:44.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:44.240153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 269/529] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:44.241009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.252838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52865f-0311-4d6c-9ec6-cea3e844da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.254254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52865f-0311-4d6c-9ec6-cea3e844da68 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.254538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52865f-0311-4d6c-9ec6-cea3e844da68 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.254823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52865f-0311-4d6c-9ec6-cea3e844da68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.332168 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52865f-0311-4d6c-9ec6-cea3e844da68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.334023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52865f-0311-4d6c-9ec6-cea3e844da68 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.369454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb3ba-9ce9-405f-92d4-86ebde50a4be None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.403702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.404672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.405076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.405486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.406326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:44.406726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.408240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.422334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 270/530] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:44.423479 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.451203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 261/531] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:44.452676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52865f-0311-4d6c-9ec6-cea3e844da68 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.527133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152301b-6736-49ce-8321-4108005ce267 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.562762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.563583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.563955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.564321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.565405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:44.566349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.568219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.578014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52865f-0311-4d6c-9ec6-cea3e844da68 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.593274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 271/532] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:44.594637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.621065 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.622329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.622617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.623169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.633639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.635102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:44.653505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:44.654613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:44.655676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:44.655676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:44.655676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:44.655676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:44.655676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:44.655676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:44.655676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:44.655676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:44.658875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 262/533] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:44.658875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.707991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebed08-dd7f-4ecc-97a3-02875f650ecf None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.748986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.749937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.750221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.750532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.760309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989400c-a524-410b-8add-b3345dddec1a None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.767143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.769352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:44.788764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:44.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:44.790777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:44.790777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:44.790777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:44.790777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:44.792475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 272/534] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:44.793554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.794795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.795448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.795724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.795995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.797187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=ec9c893558b74cf89012a50734d06ca1) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:44.797587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.799401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.813688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 263/535] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/role_assignments?user.id=ec9c893558b74cf89012a50734d06ca1&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:44.814923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.908622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4efeb7-5946-46fb-84f0-4656e1b23af8 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.945308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.946356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.946847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.947350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.948371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:44.948895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.950667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.964909 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 273/536] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:44.973786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:45.007008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab848d-4de4-42be-9ffa-e240ff971f3d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:45.087301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:45.088357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.088848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.089497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.090478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:45.091026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:45.092649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:45.111617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 264/537] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:45.118244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:45.169905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a0c4-2a1a-4709-8d0f-0448ded861a7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:45.250017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:45.250762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.250975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.251260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.252115 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=26d96159b7fb49c08b1f5c014d26f79b) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:45.252431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:45.254465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:45.260480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 274/538] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/role_assignments?user.id=26d96159b7fb49c08b1f5c014d26f79b&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:45.280213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230a4b-1f13-4ccb-9362-b047754fda06 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:45.355077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:45.355822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.356101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.356375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.370756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:45.372348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:45.393943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:45.395579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:45.396458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 265/539] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:45.402399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:45.572015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fa03f-ce9f-4a95-a034-34a10eeb2da5 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:45.618485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568348-ff65-42ca-9fb5-ab3a22add7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:45.619070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568348-ff65-42ca-9fb5-ab3a22add7ad None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.619354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568348-ff65-42ca-9fb5-ab3a22add7ad None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.619633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568348-ff65-42ca-9fb5-ab3a22add7ad None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.620429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed568348-ff65-42ca-9fb5-ab3a22add7ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:45.620738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed568348-ff65-42ca-9fb5-ab3a22add7ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:45.622196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed568348-ff65-42ca-9fb5-ab3a22add7ad None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:45.640533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 275/540] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:45.647472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:45.767633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82986803-b87e-415a-b970-f848cd21626d None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.768095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82986803-b87e-415a-b970-f848cd21626d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.768170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82986803-b87e-415a-b970-f848cd21626d None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.770123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 276/541] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:45.776660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee799-8536-4bad-bd88-c63b67d22312 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.776959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee799-8536-4bad-bd88-c63b67d22312 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.777221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bee799-8536-4bad-bd88-c63b67d22312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.807638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-18bee799-8536-4bad-bd88-c63b67d22312 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:45.809926 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-18bee799-8536-4bad-bd88-c63b67d22312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:45.836582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b8cc-bffe-4108-819a-d05e3bab7536 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:45.876624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f797958-4d74-478a-a490-f2b447b9876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:45.877212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f797958-4d74-478a-a490-f2b447b9876c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.877530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f797958-4d74-478a-a490-f2b447b9876c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.877814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f797958-4d74-478a-a490-f2b447b9876c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.879220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f797958-4d74-478a-a490-f2b447b9876c None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=378bf86fc54142ee85dc16cce3664978) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:45.879537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f797958-4d74-478a-a490-f2b447b9876c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:45.880975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f797958-4d74-478a-a490-f2b447b9876c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:45.889801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 266/542] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:45 2022] GET /identity/v3/role_assignments?user.id=378bf86fc54142ee85dc16cce3664978&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:45.890897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62c7d-8051-45de-9ccd-134e0730cbba None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.891187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62c7d-8051-45de-9ccd-134e0730cbba None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.891476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62c7d-8051-45de-9ccd-134e0730cbba None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.897661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 267/543] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:45.899107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffc2a4-e1c5-4806-bf8e-18efaddb0917 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:45.899399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffc2a4-e1c5-4806-bf8e-18efaddb0917 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:45.899680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffc2a4-e1c5-4806-bf8e-18efaddb0917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:45.917513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0fffc2a4-e1c5-4806-bf8e-18efaddb0917 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:45.918944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0fffc2a4-e1c5-4806-bf8e-18efaddb0917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:45.921343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 277/544] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:41:45.947791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bee799-8536-4bad-bd88-c63b67d22312 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.069402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bee799-8536-4bad-bd88-c63b67d22312 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:46.094309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 268/545] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:46.117819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefd707-3625-497f-98de-24467bfa9be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:46.118154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffc2a4-e1c5-4806-bf8e-18efaddb0917 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.118706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd707-3625-497f-98de-24467bfa9be7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.118996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd707-3625-497f-98de-24467bfa9be7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.119276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd707-3625-497f-98de-24467bfa9be7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.132820 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefd707-3625-497f-98de-24467bfa9be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-0cefd707-3625-497f-98de-24467bfa9be7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:46.140608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:46.141544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:46.142417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 278/546] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:46.148930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefd707-3625-497f-98de-24467bfa9be7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.227784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffc2a4-e1c5-4806-bf8e-18efaddb0917 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:46.263136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b25a67-ceb3-4ef0-bce5-591fb654c773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:46.263929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25a67-ceb3-4ef0-bce5-591fb654c773 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.264130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefd707-3625-497f-98de-24467bfa9be7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:46.264247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25a67-ceb3-4ef0-bce5-591fb654c773 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.264468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25a67-ceb3-4ef0-bce5-591fb654c773 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.276220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b25a67-ceb3-4ef0-bce5-591fb654c773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-90b25a67-ceb3-4ef0-bce5-591fb654c773 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:46.283956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:46.286328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:46.288184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 269/547] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:46.293366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b25a67-ceb3-4ef0-bce5-591fb654c773 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.334112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:46.334797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.335076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.335345 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.336112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:46.336421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:46.337966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:46.354576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 279/548] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:46.360808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.481667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e83824-2337-4d3f-aa94-b24795ebb2db None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:46.521934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:46.523134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.523416 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.523691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.536388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:46.537905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:46.558776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:46.559698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:46.561064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:46.561064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:46.561064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:46.561064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:46.561064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 280/549] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:46.562305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b25a67-ceb3-4ef0-bce5-591fb654c773 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:46.574812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.622535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:46.623554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.624012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.624461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.626620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:46.627131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:46.631419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:46.649920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 270/550] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:46.655632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.768768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b9b1b-cd98-4fcf-843d-81d64b5ed2df None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:46.812922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:46.813621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.813899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.814172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.814907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:46.815216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:46.817262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:46.849357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 281/551] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:46.854663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.866944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344d915-9f91-4966-aef7-ba0c38d3dcd4 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:46.922447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:46.923843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.924361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.924844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.945549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:46.948403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:46.977301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:46.978268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:46.979142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:46.979142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:46.979142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:46.979142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:46.979142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 271/552] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:46.984984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:47.057221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c978e20-4fa9-451e-8812-7e3dcdd8e6ee None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:47.114038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:47.114850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.115130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.115402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] PATH_INFO: `/v3/users/swift` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.126556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:47.128016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:47.147970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:47.148952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:41:47.149879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:47.153623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 282/553] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:47.155154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:47.177823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2344df-b3ed-4519-a714-f3de921216a1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:47.213445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:47.214508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.215061 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.215550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.216513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:47.217021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:47.218724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:47.237407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 272/554] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:47.239588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:47.261495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9c47b-0ee2-4354-bea7-f5dd8c52c36d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:47.334279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:47.334887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.335170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.335443 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.336469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:47.336677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:47.338303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:47.349503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c9bb-6bed-4b4b-a79e-c14515e05bcd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:47.361864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 283/555] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 13:41:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:47.364794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:47.389567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:47.390807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.391330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.391816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] PATH_INFO: `/v3/users/nova` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.400300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:47.402234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:47.419178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:47.420126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:41:47.421054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:47.423694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 273/556] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:41:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:47.430269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:47.528704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3df18-de27-4bf5-872a-b76fefc686d7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:47.535481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0db0-8c9f-45ff-8357-21f42cc0fcda None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:47.572782 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:47.573852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.574342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.574843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.575950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:47.576473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:47.578197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:47.593442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda99da-dd58-4cea-beeb-d83cf4033032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:47.594109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda99da-dd58-4cea-beeb-d83cf4033032 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.594391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda99da-dd58-4cea-beeb-d83cf4033032 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.594667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda99da-dd58-4cea-beeb-d83cf4033032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.603275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 274/557] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:41:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:47.609760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:47.701801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda99da-dd58-4cea-beeb-d83cf4033032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:47.703306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda99da-dd58-4cea-beeb-d83cf4033032 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:47.797360 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac18f-7d58-42ad-84b1-d31c2b38edce None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:47.874856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681763f-0c6e-4255-8bef-a38ceeada29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:47.875619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681763f-0c6e-4255-8bef-a38ceeada29f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.875859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681763f-0c6e-4255-8bef-a38ceeada29f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.876135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681763f-0c6e-4255-8bef-a38ceeada29f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.887780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 284/558] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:47.893539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681763f-0c6e-4255-8bef-a38ceeada29f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:47.895254 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda99da-dd58-4cea-beeb-d83cf4033032 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:47.895567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681763f-0c6e-4255-8bef-a38ceeada29f None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-d681763f-0c6e-4255-8bef-a38ceeada29f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:47.927892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:47.928807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:47.930161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:47.930161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:47.930161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:47.930161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:47.933399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 275/559] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:47.934842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc144-bf83-4c57-8541-feb4313ad3c5 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.935182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc144-bf83-4c57-8541-feb4313ad3c5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.935474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc144-bf83-4c57-8541-feb4313ad3c5 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.939260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 276/560] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:47.939260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbc144-bf83-4c57-8541-feb4313ad3c5 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.015086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda99da-dd58-4cea-beeb-d83cf4033032 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.049409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbc144-bf83-4c57-8541-feb4313ad3c5 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.050438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c699f-0f68-4d87-b079-e474ac13f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.051562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c699f-0f68-4d87-b079-e474ac13f13d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.051941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c699f-0f68-4d87-b079-e474ac13f13d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.052311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c699f-0f68-4d87-b079-e474ac13f13d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.063163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c699f-0f68-4d87-b079-e474ac13f13d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:48.065034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c699f-0f68-4d87-b079-e474ac13f13d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-1e2c699f-0f68-4d87-b079-e474ac13f13d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:48.084234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:48.085423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:48.090749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:48.090749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:48.090749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:48.090749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:48.090749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 285/561] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:48.090749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9478a-2dba-4ce6-a5a5-d8754eaefcec None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.090749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9478a-2dba-4ce6-a5a5-d8754eaefcec None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.090749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9478a-2dba-4ce6-a5a5-d8754eaefcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.096338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fa08d-fca2-4a57-b40a-0672a3bfd985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.097340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fa08d-fca2-4a57-b40a-0672a3bfd985 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.099285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fa08d-fca2-4a57-b40a-0672a3bfd985 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.099285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fa08d-fca2-4a57-b40a-0672a3bfd985 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.099285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fa08d-fca2-4a57-b40a-0672a3bfd985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:48.099285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fa08d-fca2-4a57-b40a-0672a3bfd985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:48.100339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fa08d-fca2-4a57-b40a-0672a3bfd985 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:48.110659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6fd9478a-2dba-4ce6-a5a5-d8754eaefcec None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:48.111833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6fd9478a-2dba-4ce6-a5a5-d8754eaefcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:48.118052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 277/562] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:48.118052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854f328-d225-4202-9cb3-7a501d7a66dc None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.118052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854f328-d225-4202-9cb3-7a501d7a66dc None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.118052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854f328-d225-4202-9cb3-7a501d7a66dc None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.118052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 278/563] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:48.118052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854f328-d225-4202-9cb3-7a501d7a66dc None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.194895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 286/564] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:48.196139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9478a-2dba-4ce6-a5a5-d8754eaefcec None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.227346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854f328-d225-4202-9cb3-7a501d7a66dc None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.267158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752788ad-2c89-4d56-8075-e0ce5cdb897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.267816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752788ad-2c89-4d56-8075-e0ce5cdb897f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.268094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752788ad-2c89-4d56-8075-e0ce5cdb897f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.268358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752788ad-2c89-4d56-8075-e0ce5cdb897f None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.269979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752788ad-2c89-4d56-8075-e0ce5cdb897f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:48.270190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752788ad-2c89-4d56-8075-e0ce5cdb897f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:48.271698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752788ad-2c89-4d56-8075-e0ce5cdb897f None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:48.288762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 279/565] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:48.288762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dafd9b-f2d2-40df-b18b-ac112c031653 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.288762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dafd9b-f2d2-40df-b18b-ac112c031653 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.288762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dafd9b-f2d2-40df-b18b-ac112c031653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.303013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-05dafd9b-f2d2-40df-b18b-ac112c031653 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:48.304209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-05dafd9b-f2d2-40df-b18b-ac112c031653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:48.316122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9478a-2dba-4ce6-a5a5-d8754eaefcec None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.350870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.351955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.352236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.352510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.360145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:48.361710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:48.373064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 280/566] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:48.374234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dafd9b-f2d2-40df-b18b-ac112c031653 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:48.376228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:48.377212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:48.378708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 287/567] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:48.379228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.491026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dafd9b-f2d2-40df-b18b-ac112c031653 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.498631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d886fc-fd72-49b4-b396-3e785693be6e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.524695 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72fc83-e449-4b3e-90f3-3fedb6344337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.525886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72fc83-e449-4b3e-90f3-3fedb6344337 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.526408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72fc83-e449-4b3e-90f3-3fedb6344337 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.526903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72fc83-e449-4b3e-90f3-3fedb6344337 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.533057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.533883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.534160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.534610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.538939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72fc83-e449-4b3e-90f3-3fedb6344337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:48.541697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:48.543142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-2e72fc83-e449-4b3e-90f3-3fedb6344337 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:48.547788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:48.548710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:48.549709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:48.556765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 281/568] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:48.556765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72fc83-e449-4b3e-90f3-3fedb6344337 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:48.558463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:48.564782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 288/569] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:48.566808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.657736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72fc83-e449-4b3e-90f3-3fedb6344337 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.666011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f9f87-e971-4bf7-a456-df496efb7195 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.692061 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.692716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.692999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.693303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.694094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:48.694401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:48.695828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:48.698940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4873-b6a2-4a58-afea-70f123bf9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.699722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4873-b6a2-4a58-afea-70f123bf9547 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.700000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4873-b6a2-4a58-afea-70f123bf9547 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.700272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4873-b6a2-4a58-afea-70f123bf9547 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.708278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 282/570] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:48.709091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.712128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea4873-b6a2-4a58-afea-70f123bf9547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b5ea4873-b6a2-4a58-afea-70f123bf9547 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:48.720143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:48.721273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 289/571] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:48.727882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4873-b6a2-4a58-afea-70f123bf9547 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.807949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a76ae-5161-4b0f-a741-f21260217e5c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.825952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4873-b6a2-4a58-afea-70f123bf9547 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.841913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16bfd8-629c-4535-8913-a3fc72948adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.842578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16bfd8-629c-4535-8913-a3fc72948adf None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.842862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16bfd8-629c-4535-8913-a3fc72948adf None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.843138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16bfd8-629c-4535-8913-a3fc72948adf None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.843889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16bfd8-629c-4535-8913-a3fc72948adf None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:48.844191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16bfd8-629c-4535-8913-a3fc72948adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:48.845592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16bfd8-629c-4535-8913-a3fc72948adf None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:48.854287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 283/572] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:48.855815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441318-2571-41bf-b33b-0d80193d0e29 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.856101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441318-2571-41bf-b33b-0d80193d0e29 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.856373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441318-2571-41bf-b33b-0d80193d0e29 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.859375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 284/573] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:48.859375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441318-2571-41bf-b33b-0d80193d0e29 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.861751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.862411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.862800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.863108 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.863895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:48.864201 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:48.865659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:48.877858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 290/574] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:48.879000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:48.959056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441318-2571-41bf-b33b-0d80193d0e29 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.975694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25eaff-6e7a-4db7-b09c-b25355b07910 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:48.991804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948878c-1f8c-4f69-9c0d-87b3dbff0837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:48.992713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948878c-1f8c-4f69-9c0d-87b3dbff0837 None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.992992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948878c-1f8c-4f69-9c0d-87b3dbff0837 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.993287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948878c-1f8c-4f69-9c0d-87b3dbff0837 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/f6da21ec482e47399411baa3c33f4f21/roles/0827027c0db142779b191de9ce1ece80` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.007755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948878c-1f8c-4f69-9c0d-87b3dbff0837 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=f6da21ec482e47399411baa3c33f4f21, role_id=0827027c0db142779b191de9ce1ece80)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.009232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948878c-1f8c-4f69-9c0d-87b3dbff0837 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.009684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.010354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.010640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.010919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.011673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:49.011980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.013364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.022089 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 291/575] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:49.022889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.110296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 285/576] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:48 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/f6da21ec482e47399411baa3c33f4f21/roles/0827027c0db142779b191de9ce1ece80 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:49.111590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469de3-1657-4deb-bfd7-9ad1577329a5 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.111877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469de3-1657-4deb-bfd7-9ad1577329a5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.112154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469de3-1657-4deb-bfd7-9ad1577329a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.120137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab121bd-694b-4071-8a24-ffeed7aee340 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.135131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-56469de3-1657-4deb-bfd7-9ad1577329a5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:49.136383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-56469de3-1657-4deb-bfd7-9ad1577329a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:49.158951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.160712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.161018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.161304 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.173583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.175707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:49.194744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:49.195882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:49.196857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:49.196857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:49.196857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:49.196857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:49.196857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 292/577] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:49.197375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.218416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 286/578] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:49.219319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56469de3-1657-4deb-bfd7-9ad1577329a5 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.317756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f609e-630a-4e2e-9487-31d7be209a87 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.332835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56469de3-1657-4deb-bfd7-9ad1577329a5 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.352884 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.353571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.353851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.354125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.355215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=52aa32e8c0f742659725ddec932014b8) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:49.355513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.356930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.363017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 293/579] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/role_assignments?user.id=52aa32e8c0f742659725ddec932014b8&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:49.363981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.373772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.374946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.375428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.375888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.387977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.389517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:49.413777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:49.414730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:49.415598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:49.415598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:49.415598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:49.415598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:49.420317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 287/580] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:49.421392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.498174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e75d65-e7f8-4469-a728-ed5838a01841 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.536550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.537138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.537485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.537766 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.538499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:49.538802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.540283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.558371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 294/581] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:49.559392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.559794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c262fb-fe2e-423a-8de0-cbbfd1562f5f None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.602014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3fe1-549b-4dc9-a004-1f4ccf46da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.602814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3fe1-549b-4dc9-a004-1f4ccf46da69 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.603092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3fe1-549b-4dc9-a004-1f4ccf46da69 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.603361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f3fe1-549b-4dc9-a004-1f4ccf46da69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.614389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f3fe1-549b-4dc9-a004-1f4ccf46da69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-770f3fe1-549b-4dc9-a004-1f4ccf46da69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:49.622260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:49.623390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:49.624618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 288/582] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:49.625366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3fe1-549b-4dc9-a004-1f4ccf46da69 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.693293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8be26-c918-4b9d-8135-a884e95f6857 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.730735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.731775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.732203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.732465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f3fe1-549b-4dc9-a004-1f4ccf46da69 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.732795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.733700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:49.734147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.735680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.751617 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 295/583] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:49.752755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.779209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.780012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.780289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.780556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.789135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.790607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:49.805138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:49.806356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:41:49.807461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:49.812203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 289/584] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:49.813111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.867814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d3d86-48fc-4836-a47a-36cb2377b071 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.903848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.904924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.905533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.905954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.906849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:49.907299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.909003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.913897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e182879-a2c7-4aa3-8638-6b595e29b509 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.919082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 296/585] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:49.920259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.948872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.949658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.949939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.950211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.958393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.960189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:49.974867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:49.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 13:41:49.977271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:49.981169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 290/586] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:49.981897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.033678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e7128-e2b5-4d48-9869-db50b409cc8e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.070933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.071895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.072371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.072787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.073876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:50.074346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.075941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.084622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c6c6c-ca1e-4966-bf13-36877b0aa8a5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.095590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 297/587] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:50.096753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.124554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.125418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.125629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.125907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.137069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.138560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:50.156707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:50.157977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:50.159309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:50.159309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:50.159309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:50.159309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:50.159309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 291/588] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:50.159309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.210387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84850-3ec9-40f8-99f2-6604b3b7d5cc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.247558 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.248510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.248978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.249437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.250524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:50.250982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.252560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.263956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3ebd5-74f6-4142-bf79-8337ed2987c2 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.274583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 298/589] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:50.275647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.304737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.305586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.305864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.306137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.318321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.319780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:50.338332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:50.339467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:50.340387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:50.340387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:50.340387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:50.340387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:50.344433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 292/590] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:50.345183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.391376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bccd12-635d-45af-83e1-723ee809f450 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.429402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.430394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.430880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.431298 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.432227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:50.432681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.434334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.448382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 299/591] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:50.449636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.449751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23264d22-fc20-4cf7-9d4f-bfbda72404a5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.484630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.485540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.485763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.486101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.498118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.499553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:50.517098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:50.518116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:50.519907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:50.519907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:50.519907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:50.519907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:50.523535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 293/592] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:50.524432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.564253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba23ee-73de-4c80-b6c9-cc94cb2040b1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.603893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.605066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.605590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.611296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.611296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:50.611296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.611296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.623052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 300/593] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:50.624271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.635056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa054a-60e8-422b-8880-9d72947845e7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.670094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.670502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.670778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.671051 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.681023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:50.696403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:50.697628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 294/594] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:50.698907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.742814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d355d-018e-4389-8bc2-984c4af406e8 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.780507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.781492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.781937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.782362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.783231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:50.783682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.785893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.803939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 301/595] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:50.805217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.813924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f0ff6-056a-410c-bf25-0ef49e86eb68 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.849904 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.850699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.850974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.851242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.858639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.860329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:50.875496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:50.876537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:50.877642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 295/596] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:50.882509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.924311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eea256-c873-4641-9158-a1b31ff44f6a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:50.963539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:50.964467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:50.964928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:50.965403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:50.966455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:50.966995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:50.968609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:50.989453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 302/597] 10.222.0.69 () {56 vars in 1139 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:50.990788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:50.993015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5c05-5b4c-4c69-b877-72ec8ae0e7fe None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.030869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.031821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.032173 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.032516 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.042173 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.044282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:51.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:51.064682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:51.067458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:51.067458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:51.067458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:51.067458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:51.067458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:51.067458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:51.067458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:51.067458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:51.070428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 296/598] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:51.071400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:51.108453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28288d8-3f7e-4f77-b88a-532e3bfd56cb None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.156871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.157970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.158463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.158962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.160641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:51.161170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.162898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.175970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 303/599] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:51.177379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:51.189522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbce3d-b443-4e1c-b4bd-b915ba564c62 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.225739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.226560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.226841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.227114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.238652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.240167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:51.259084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:51.260010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:51.262081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:51.262081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:51.262081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:51.262081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:51.262081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 297/600] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:51.262081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:51.293837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa4751-2cd0-4ab3-bb69-56114aabe2d6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.336822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.337931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.338423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.338988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.339999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:51.340513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.342229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.357153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 304/601] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:51.358464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:51.375319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83a6a0-d4aa-408e-acbe-104496b43961 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.414703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09cfa4-15c7-476d-8635-f33bd5cb0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.415630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cfa4-15c7-476d-8635-f33bd5cb0874 None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.415913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cfa4-15c7-476d-8635-f33bd5cb0874 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.416189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cfa4-15c7-476d-8635-f33bd5cb0874 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/ec9c893558b74cf89012a50734d06ca1/roles/0827027c0db142779b191de9ce1ece80` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.435021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09cfa4-15c7-476d-8635-f33bd5cb0874 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=ec9c893558b74cf89012a50734d06ca1, role_id=0827027c0db142779b191de9ce1ece80)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.436393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09cfa4-15c7-476d-8635-f33bd5cb0874 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.468273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d557659-81c3-4d42-af0e-47de6bc6730c None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.502702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.503939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.504224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.504491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.505444 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:51.505757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.507141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.519119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 305/602] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:51.521349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:51.528323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 298/603] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:51 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/ec9c893558b74cf89012a50734d06ca1/roles/0827027c0db142779b191de9ce1ece80 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:51.530636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e112c-d2ee-49b5-80d6-5d860be0b266 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.531264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e112c-d2ee-49b5-80d6-5d860be0b266 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.531710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e112c-d2ee-49b5-80d6-5d860be0b266 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.533622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 299/604] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:51.537738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e112c-d2ee-49b5-80d6-5d860be0b266 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:51.656591 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c194db-c310-4fac-8f04-30c06fc23ad6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.667899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e112c-d2ee-49b5-80d6-5d860be0b266 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.707073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1d24f-4619-4e3a-af51-98a1deebf0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.707836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1d24f-4619-4e3a-af51-98a1deebf0c2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.708119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1d24f-4619-4e3a-af51-98a1deebf0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.708394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1d24f-4619-4e3a-af51-98a1deebf0c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.712981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcf8c3-9e8a-4762-91ab-b06dd6ea140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.714310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcf8c3-9e8a-4762-91ab-b06dd6ea140f None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.714859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcf8c3-9e8a-4762-91ab-b06dd6ea140f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.715351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcf8c3-9e8a-4762-91ab-b06dd6ea140f None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/26d96159b7fb49c08b1f5c014d26f79b/roles/0827027c0db142779b191de9ce1ece80` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.717030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1d24f-4619-4e3a-af51-98a1deebf0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.718878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1d24f-4619-4e3a-af51-98a1deebf0c2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.736365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcf8c3-9e8a-4762-91ab-b06dd6ea140f None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=26d96159b7fb49c08b1f5c014d26f79b, role_id=0827027c0db142779b191de9ce1ece80)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-bfa1d24f-4619-4e3a-af51-98a1deebf0c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:51.736820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:51.738059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:51.738943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:51.738943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:51.738943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:51.738943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:51.738943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:51.738943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:51.738943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:51.738943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:51.740947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcf8c3-9e8a-4762-91ab-b06dd6ea140f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.743437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 300/605] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:51.744869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5269-bc57-404a-a428-22611f76c660 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.745131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5269-bc57-404a-a428-22611f76c660 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.746073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5269-bc57-404a-a428-22611f76c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.766448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-44dc5269-bc57-404a-a428-22611f76c660 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:51.767882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-44dc5269-bc57-404a-a428-22611f76c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:51.835013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 301/606] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:51.836136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc5269-bc57-404a-a428-22611f76c660 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:51.850435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 306/607] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:51 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/26d96159b7fb49c08b1f5c014d26f79b/roles/0827027c0db142779b191de9ce1ece80 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:51.852167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d26f17-3b61-415d-a665-970bd8c54aea None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.852566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d26f17-3b61-415d-a665-970bd8c54aea None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.853494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d26f17-3b61-415d-a665-970bd8c54aea None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.857371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 307/608] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:51.862570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf955-6e13-481f-ad2d-c0cf73f4ccd0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.863642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf955-6e13-481f-ad2d-c0cf73f4ccd0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.864126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf955-6e13-481f-ad2d-c0cf73f4ccd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.888086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-23bdf955-6e13-481f-ad2d-c0cf73f4ccd0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:51.890198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-23bdf955-6e13-481f-ad2d-c0cf73f4ccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:51.955714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc5269-bc57-404a-a428-22611f76c660 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.985799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 308/609] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:51.987024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf955-6e13-481f-ad2d-c0cf73f4ccd0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.008451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.009149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.009484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.009762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.010581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:52.010894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:52.012486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:52.032303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 302/610] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:52.033283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.109075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf955-6e13-481f-ad2d-c0cf73f4ccd0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:52.154358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aead63-0be4-44c1-8767-effba4f752ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.155069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f96812-6bfb-46c5-b26f-f56d7f046274 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:52.155203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aead63-0be4-44c1-8767-effba4f752ea None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.155411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aead63-0be4-44c1-8767-effba4f752ea None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.155683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aead63-0be4-44c1-8767-effba4f752ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.167760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aead63-0be4-44c1-8767-effba4f752ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-c1aead63-0be4-44c1-8767-effba4f752ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:52.178148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:52.179123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:52.179947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 309/611] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:52.180628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aead63-0be4-44c1-8767-effba4f752ea None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.195433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b2794-f340-4c4c-a22c-8b66d12800dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.196565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2794-f340-4c4c-a22c-8b66d12800dc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.197048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2794-f340-4c4c-a22c-8b66d12800dc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.197546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b2794-f340-4c4c-a22c-8b66d12800dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.212112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b2794-f340-4c4c-a22c-8b66d12800dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-063b2794-f340-4c4c-a22c-8b66d12800dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:52.222184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:52.223155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:52.223965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 303/612] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:52.224654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b2794-f340-4c4c-a22c-8b66d12800dc None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.298191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aead63-0be4-44c1-8767-effba4f752ea None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:52.335435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55308087-8206-4c3e-8534-abdafaac61c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.336329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308087-8206-4c3e-8534-abdafaac61c0 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.336606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308087-8206-4c3e-8534-abdafaac61c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.336875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308087-8206-4c3e-8534-abdafaac61c0 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/378bf86fc54142ee85dc16cce3664978/roles/0827027c0db142779b191de9ce1ece80` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.356480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b2794-f340-4c4c-a22c-8b66d12800dc None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:52.359841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55308087-8206-4c3e-8534-abdafaac61c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=378bf86fc54142ee85dc16cce3664978, role_id=0827027c0db142779b191de9ce1ece80)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:52.360742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55308087-8206-4c3e-8534-abdafaac61c0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:52.390724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.391758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.392116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.392469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.393317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:52.394245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:52.395692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:52.404289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 304/613] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:52.410746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.443699 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 310/614] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:52 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/378bf86fc54142ee85dc16cce3664978/roles/0827027c0db142779b191de9ce1ece80 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:52.444540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55308087-8206-4c3e-8534-abdafaac61c0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.591842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd417-9106-41c5-bcdb-c5f6d1532056 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:52.643717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55308087-8206-4c3e-8534-abdafaac61c0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:52.662436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.663124 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.663406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.663679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.664445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:52.664749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:52.666191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:52.676064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 305/615] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:52.682367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.712927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.713830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.714116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.714388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.729178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:52.730964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:52.749724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:52.750705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:52.751577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:52.751577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:52.751577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:52.751577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:52.756297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 311/616] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:52.757256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.818116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5682-4e6a-4cf0-bee0-12444ff2f1e4 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:52.852847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.853730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.854109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.854481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.866602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:52.868174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:52.868801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544a50f-3d98-4462-b464-9603c4fa339d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:52.885935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:52.887070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:52.888146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:52.888146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:52.888146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:52.888146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:52.889717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 306/617] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:52.897456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:52.907920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:52.908800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:52.910101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:52.910483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:52.911318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:52.911784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:52.913764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:52.928223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 312/618] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:52.933860 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.011582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d05ef-9879-4043-a3fc-f91bbac950c2 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.048686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.049733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.050677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb41b-5840-48fe-83d5-0462aeed5c4d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.050978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.051457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.052401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:53.052927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:53.054607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:53.083554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 307/619] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:53.088435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.089251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.089534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.089806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.090111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.099214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:53.100662 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:53.117276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:53.118641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:53.119554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 313/620] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:41:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:53.124267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.239942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220a60-e7ff-4960-9e25-4fc170da2628 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.277455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.278125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.278403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.278673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.279807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:53.280111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:53.281734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:53.309728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 314/621] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:41:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:53.311878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.316790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacc361-f6a4-414c-88d4-798b5a15c939 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.385034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.386210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.386720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.387194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] PATH_INFO: `/v3/users/swift` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.402952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:53.405536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:53.441062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:53.442231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:53.443178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 308/622] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:53.448792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.476633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a1e65-9557-4492-b5c9-8974757b4363 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.514519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b2c4c-f8dc-44bb-bcd8-b8623d08fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.515607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b2c4c-f8dc-44bb-bcd8-b8623d08fd33 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.516140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b2c4c-f8dc-44bb-bcd8-b8623d08fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.516611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b2c4c-f8dc-44bb-bcd8-b8623d08fd33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.587555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b2c4c-f8dc-44bb-bcd8-b8623d08fd33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:53.589405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b2c4c-f8dc-44bb-bcd8-b8623d08fd33 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:53.647462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66869-3d4b-482a-9d77-cfdd6065557d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.714940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.716032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.716518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.717028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.718108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:53.722491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:53.724300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:53.755885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 309/623] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 13:41:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:53.766627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.779277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 315/624] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:41:53.780484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b2c4c-f8dc-44bb-bcd8-b8623d08fd33 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.917553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797e18-a99d-4715-a5a8-dea1213f5a91 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.937419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b2c4c-f8dc-44bb-bcd8-b8623d08fd33 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.948807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.957309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.957309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.957309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.962396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:53.963869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:53.983830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:53.984802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:53.985747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:53.985747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:53.985747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:53.985747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:53.985747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 310/625] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:41:53.991705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.994105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.995201 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.995730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.996234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.017399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:54.021900 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:54.051040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:54.051987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:54.052856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:54.052856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:54.052856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:54.052856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:54.061797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 316/626] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:54.067470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:54.140137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcdd3f-ba19-45a5-804a-64675f95d245 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.252459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35618ca-07ab-414a-9561-08a327d7fd7f None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.293869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ec16a-80ea-480a-b08f-57d5261434f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.294927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ec16a-80ea-480a-b08f-57d5261434f8 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.295410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ec16a-80ea-480a-b08f-57d5261434f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.295944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ec16a-80ea-480a-b08f-57d5261434f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.296920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ec16a-80ea-480a-b08f-57d5261434f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:54.297475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ec16a-80ea-480a-b08f-57d5261434f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:54.299197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ec16a-80ea-480a-b08f-57d5261434f8 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:54.311881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 317/627] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:41:54.313558 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86348-2d34-47f1-8e26-34e6be15b78c None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.314050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86348-2d34-47f1-8e26-34e6be15b78c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.314564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86348-2d34-47f1-8e26-34e6be15b78c None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.317005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 318/628] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:54.322463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d86348-2d34-47f1-8e26-34e6be15b78c None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:54.338057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747117c4-d6a0-4c79-ae6e-af6017e17165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.339515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747117c4-d6a0-4c79-ae6e-af6017e17165 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.340042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747117c4-d6a0-4c79-ae6e-af6017e17165 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.340841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747117c4-d6a0-4c79-ae6e-af6017e17165 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.342195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747117c4-d6a0-4c79-ae6e-af6017e17165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:54.342731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747117c4-d6a0-4c79-ae6e-af6017e17165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:54.345202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747117c4-d6a0-4c79-ae6e-af6017e17165 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:54.361806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 311/629] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:54.363764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc28bcc-0ad7-4234-8e10-6dc16b12ddca None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.364461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc28bcc-0ad7-4234-8e10-6dc16b12ddca None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.365836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc28bcc-0ad7-4234-8e10-6dc16b12ddca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.387146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7cc28bcc-0ad7-4234-8e10-6dc16b12ddca None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:54.389324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7cc28bcc-0ad7-4234-8e10-6dc16b12ddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:54.435446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d86348-2d34-47f1-8e26-34e6be15b78c None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.462820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 312/630] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:54.464171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc28bcc-0ad7-4234-8e10-6dc16b12ddca None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:54.475787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.476880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.477017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.477231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.485632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:54.488265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:54.507130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:54.508093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:54.508990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 319/631] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:54.509559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:54.574463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc28bcc-0ad7-4234-8e10-6dc16b12ddca None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.611217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.612466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.618624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.618624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.618815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8575-9801-4b04-8299-1b85a5cfbdad None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.621256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:54.622981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:54.637913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:54.638859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:54.639842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:54.639842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:54.639842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:54.639842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:54.639842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:54.639842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:54.639842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:54.639842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:54.643422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 313/632] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:54.645346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:54.654326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0ba2f-e0b5-4592-883a-8584d794bcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.655135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ba2f-e0b5-4592-883a-8584d794bcf8 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.655471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ba2f-e0b5-4592-883a-8584d794bcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.655746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ba2f-e0b5-4592-883a-8584d794bcf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.668892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0ba2f-e0b5-4592-883a-8584d794bcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-7fe0ba2f-e0b5-4592-883a-8584d794bcf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:54.677605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:54.678619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:54.679453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 320/633] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:54.680410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0ba2f-e0b5-4592-883a-8584d794bcf8 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:54.765093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eda66-6ffe-4034-b5ea-f22564271b63 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.785696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0ba2f-e0b5-4592-883a-8584d794bcf8 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.809883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c99b50-7b4d-4550-910c-ae9cb978ab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.810549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c99b50-7b4d-4550-910c-ae9cb978ab77 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.810833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c99b50-7b4d-4550-910c-ae9cb978ab77 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.811109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c99b50-7b4d-4550-910c-ae9cb978ab77 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.811905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c99b50-7b4d-4550-910c-ae9cb978ab77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:54.812226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c99b50-7b4d-4550-910c-ae9cb978ab77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:54.813703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c99b50-7b4d-4550-910c-ae9cb978ab77 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:54.819860 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.820922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.820922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.821119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.821854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:54.822160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:54.823573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:54.831620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 314/634] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:54.831620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab788813-153a-491c-ab7a-364731b9e098 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.831620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab788813-153a-491c-ab7a-364731b9e098 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.831620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab788813-153a-491c-ab7a-364731b9e098 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.831620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 315/635] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:54.831620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab788813-153a-491c-ab7a-364731b9e098 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:54.842913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 321/636] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:54.843771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:54.942475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab788813-153a-491c-ab7a-364731b9e098 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.954861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437a29-48fa-44f0-bc9b-5b50bcb70a9b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:54.984326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b62cf-43f2-4583-a5ab-3172c0e4f062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.985015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b62cf-43f2-4583-a5ab-3172c0e4f062 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.985341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b62cf-43f2-4583-a5ab-3172c0e4f062 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.985613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b62cf-43f2-4583-a5ab-3172c0e4f062 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.986383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b62cf-43f2-4583-a5ab-3172c0e4f062 None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:54.986687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b62cf-43f2-4583-a5ab-3172c0e4f062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:54.988525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b62cf-43f2-4583-a5ab-3172c0e4f062 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:54.994315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:54.994992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:54.995277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:54.995556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:54.996405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=f6da21ec482e47399411baa3c33f4f21) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:54.996715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:55.002394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 316/637] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:55.002576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:55.002694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9e4f-014d-4a12-b1be-df50e87ea300 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.002694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9e4f-014d-4a12-b1be-df50e87ea300 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.002694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b9e4f-014d-4a12-b1be-df50e87ea300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.017450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 322/638] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:54 2022] GET /identity/v3/role_assignments?user.id=f6da21ec482e47399411baa3c33f4f21&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:55.017450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.025817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-fd8b9e4f-014d-4a12-b1be-df50e87ea300 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:55.027575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-fd8b9e4f-014d-4a12-b1be-df50e87ea300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:55.123999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0445-eb38-49bb-beb0-fc0f62ec1145 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:55.129112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 317/639] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:55.130185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b9e4f-014d-4a12-b1be-df50e87ea300 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.163037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451173-e8a1-4c30-bff1-d2dce9430581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:55.164150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451173-e8a1-4c30-bff1-d2dce9430581 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.164536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451173-e8a1-4c30-bff1-d2dce9430581 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.164935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451173-e8a1-4c30-bff1-d2dce9430581 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/52aa32e8c0f742659725ddec932014b8/roles/0827027c0db142779b191de9ce1ece80` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.186399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451173-e8a1-4c30-bff1-d2dce9430581 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=52aa32e8c0f742659725ddec932014b8, role_id=0827027c0db142779b191de9ce1ece80)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:55.188388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451173-e8a1-4c30-bff1-d2dce9430581 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:55.241339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b9e4f-014d-4a12-b1be-df50e87ea300 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:55.276707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aed9d-523a-4614-9ba1-3f31aa2567ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:55.277525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aed9d-523a-4614-9ba1-3f31aa2567ce None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.278092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aed9d-523a-4614-9ba1-3f31aa2567ce None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.278092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aed9d-523a-4614-9ba1-3f31aa2567ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.282819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 323/640] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:41:55 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/52aa32e8c0f742659725ddec932014b8/roles/0827027c0db142779b191de9ce1ece80 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:41:55.283504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451173-e8a1-4c30-bff1-d2dce9430581 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.288752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aed9d-523a-4614-9ba1-3f31aa2567ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:55.290346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aed9d-523a-4614-9ba1-3f31aa2567ce None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-102aed9d-523a-4614-9ba1-3f31aa2567ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:55.314018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:55.314950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:55.316482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:55.316482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:55.316482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:55.316482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:55.316482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 318/641] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:55.318657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3c13-be66-46ed-9cc4-aa14ef02ff80 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.318949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3c13-be66-46ed-9cc4-aa14ef02ff80 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.319227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3c13-be66-46ed-9cc4-aa14ef02ff80 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.320812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 319/642] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:55.323637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a3c13-be66-46ed-9cc4-aa14ef02ff80 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.443664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451173-e8a1-4c30-bff1-d2dce9430581 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:55.450391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a3c13-be66-46ed-9cc4-aa14ef02ff80 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:55.490165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f902fb0-656d-4ad6-a1fd-eed6e4af12f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:55.491041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f902fb0-656d-4ad6-a1fd-eed6e4af12f7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.491394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f902fb0-656d-4ad6-a1fd-eed6e4af12f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.491731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e7dc-77f2-4368-977f-5fb9bdbdac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:55.491868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f902fb0-656d-4ad6-a1fd-eed6e4af12f7 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.492590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f902fb0-656d-4ad6-a1fd-eed6e4af12f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:55.492972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f902fb0-656d-4ad6-a1fd-eed6e4af12f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:55.493222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e7dc-77f2-4368-977f-5fb9bdbdac52 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.493782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e7dc-77f2-4368-977f-5fb9bdbdac52 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.494120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6e7dc-77f2-4368-977f-5fb9bdbdac52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.494451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f902fb0-656d-4ad6-a1fd-eed6e4af12f7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:55.509548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6e7dc-77f2-4368-977f-5fb9bdbdac52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:55.512675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 320/643] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:55.514346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40cffe-6e43-4666-b549-67660b9c68e5 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.523372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40cffe-6e43-4666-b549-67660b9c68e5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.523372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40cffe-6e43-4666-b549-67660b9c68e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-8de6e7dc-77f2-4368-977f-5fb9bdbdac52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:55.523567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:55.524581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 324/644] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:55.525460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e7dc-77f2-4368-977f-5fb9bdbdac52 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.535591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0c40cffe-6e43-4666-b549-67660b9c68e5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:55.537124 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0c40cffe-6e43-4666-b549-67660b9c68e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:55.626720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 321/645] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:55.629791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40cffe-6e43-4666-b549-67660b9c68e5 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.645055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6e7dc-77f2-4368-977f-5fb9bdbdac52 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:55.696132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:55.696938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.697218 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.697513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.712920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:55.715237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:55.735585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:55.736813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:41:55.738347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:55.741096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 325/646] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:55.742191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.756478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40cffe-6e43-4666-b549-67660b9c68e5 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:55.798649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:55.799767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.800216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.801137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.802338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:55.802787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:55.804980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:55.817463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 322/647] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:55.818658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.857185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3039223-09c9-45dc-ad7b-3e72357351b9 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:55.893955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea51c0-80e8-4d5e-9d75-3458d3e2449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:55.894951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea51c0-80e8-4d5e-9d75-3458d3e2449d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:55.895357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea51c0-80e8-4d5e-9d75-3458d3e2449d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:55.896112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea51c0-80e8-4d5e-9d75-3458d3e2449d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:55.906547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea51c0-80e8-4d5e-9d75-3458d3e2449d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-d2ea51c0-80e8-4d5e-9d75-3458d3e2449d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:55.915243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:55.916417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:55.917496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:55.924027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 326/648] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:55.925683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea51c0-80e8-4d5e-9d75-3458d3e2449d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:55.957706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946eac3-6012-4daf-b6f1-9c68af9cdf23 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.001431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.002355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.003348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.004041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.005744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:56.006203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.008442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.030378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 323/649] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 13:41:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:56.031307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.032584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea51c0-80e8-4d5e-9d75-3458d3e2449d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.077651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.079193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.079631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.080300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.095409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.097798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:56.122169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:56.123319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:56.124397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:56.124397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:56.124397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:56.124397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:56.126755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 327/650] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:56.129048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.139071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e8884-96af-4dfc-8972-6c02ca226aff None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.174431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.175806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.176188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.176574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.177606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:56.178075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.179539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.188216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 324/651] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:56.193576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.262501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc0fda-99d1-4431-95f9-6db043b6250d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.299554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95a83-4204-456c-bd02-0a5ab5d32dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.300608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95a83-4204-456c-bd02-0a5ab5d32dba None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.301037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95a83-4204-456c-bd02-0a5ab5d32dba None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.301470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95a83-4204-456c-bd02-0a5ab5d32dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.320823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948043c6-d45f-461d-a7cb-c88df069e48d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.356804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.357705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.358099 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.358484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.359334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:56.359755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.361280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.375022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 325/652] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:56.376215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.387163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95a83-4204-456c-bd02-0a5ab5d32dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.389132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95a83-4204-456c-bd02-0a5ab5d32dba None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.480654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfd72d-32de-4c6c-9d4e-868bb5172ac2 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.505758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 328/653] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:56.506765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95a83-4204-456c-bd02-0a5ab5d32dba None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.519825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.520809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.521162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.521539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.532508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.534307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:56.552654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:56.554507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:56.556710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:56.556710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:56.556710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:56.556710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:56.556710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 326/654] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:56.556710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.616126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95a83-4204-456c-bd02-0a5ab5d32dba None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.653796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.654592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.655008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.655283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.666027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.667100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb546f-c4a3-49a2-bf13-196c5bc812ed None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.668429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:56.683868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:56.686098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 329/655] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:56.688429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.703117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.703909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.704189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.704465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.715236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.716834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:56.735487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:56.739021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:56.741174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:56.741174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:56.741174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:56.741174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:56.741174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 327/656] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:56.741174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.795764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdca6d-0691-4c71-b298-a354ba8d4799 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.834659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.836025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.836308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.836630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.837473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:56.837785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.839164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.846688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed987d-05e3-45cd-9c94-50941e601e27 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.852494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 330/657] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:56.853372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.887719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.888361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.888653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.888934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.889822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:56.890134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.891576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.912684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 328/658] 10.222.0.69 () {56 vars in 1137 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:56.913700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.972307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caf978-dd74-4a15-a779-819e289d0a37 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.008403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.009067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.009372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.009645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.010484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:57.010788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.012166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.021358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccfa6f-d40e-49a5-b8ec-affb2fb50a9d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.030423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 331/659] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:57.031411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:57.058778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.059586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.059871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.060151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.068830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.070353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:57.086342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:57.088610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:41:57.090868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:57.097280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 329/660] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:57.097280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:57.140308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba620e-b1e2-4f6b-bdc4-c569535d9922 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.175822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634100-1c2c-4ddc-bf2f-47eb2cf5a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.176470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634100-1c2c-4ddc-bf2f-47eb2cf5a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.176749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634100-1c2c-4ddc-bf2f-47eb2cf5a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.177020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634100-1c2c-4ddc-bf2f-47eb2cf5a4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.228715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35482-1900-4f18-a601-b947270d5290 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.255109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84634100-1c2c-4ddc-bf2f-47eb2cf5a4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.257176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84634100-1c2c-4ddc-bf2f-47eb2cf5a4c0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.273125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.274225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.274670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.275106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.282438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.284155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:57.303942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:57.305185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:57.306415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:57.306415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:57.306415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:57.306415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:57.306415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:57.306415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:57.306415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:57.306415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:57.308796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 330/661] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:57.309842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:57.372289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 332/662] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:57.373404 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634100-1c2c-4ddc-bf2f-47eb2cf5a4c0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:57.437893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e97003-6b36-4591-99bf-94b7db7ebb44 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.482816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.483804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.484253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.484690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.486468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:57.487866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.490247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.505136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634100-1c2c-4ddc-bf2f-47eb2cf5a4c0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.516425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 331/663] 10.222.0.69 () {56 vars in 1139 bytes} [Wed May 4 13:41:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:57.516425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:57.555742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.556663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.557117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.558084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.559060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:57.559530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.561824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.579004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 333/664] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:57.580118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:57.627116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f6b3a-8328-45b1-a219-c945af0f39ce None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.662479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.663119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.663406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.663683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.674659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.676946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:57.697998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:57.698938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:57.699814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:57.699814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:57.699814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:57.699814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:57.700056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547568c-295d-4549-8c8e-9568f229cfb5 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.700152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 332/665] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:57.700152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:57.732344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1760e-8373-4473-a66b-3d90936c5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.732986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1760e-8373-4473-a66b-3d90936c5a0e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.733291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1760e-8373-4473-a66b-3d90936c5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.733566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1760e-8373-4473-a66b-3d90936c5a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.798613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d1b93-053a-4a87-8620-5403778dc742 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:57.800325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1760e-8373-4473-a66b-3d90936c5a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.801838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1760e-8373-4473-a66b-3d90936c5a0e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.831864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e6d49-41bb-4b19-aa1a-12720d08cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:57.832533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6d49-41bb-4b19-aa1a-12720d08cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.832809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6d49-41bb-4b19-aa1a-12720d08cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.833077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6d49-41bb-4b19-aa1a-12720d08cdd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.833943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e6d49-41bb-4b19-aa1a-12720d08cdd2 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=ec9c893558b74cf89012a50734d06ca1) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:57.834249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e6d49-41bb-4b19-aa1a-12720d08cdd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:57.835663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e6d49-41bb-4b19-aa1a-12720d08cdd2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:57.841422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 333/666] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:57 2022] GET /identity/v3/role_assignments?user.id=ec9c893558b74cf89012a50734d06ca1&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:57.842714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4e5a5-3232-47b9-8a2f-9ddd23f89621 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.842997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4e5a5-3232-47b9-8a2f-9ddd23f89621 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.843277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4e5a5-3232-47b9-8a2f-9ddd23f89621 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.844489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 334/667] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:57.845608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d505f7-aa99-46c7-a40b-c41b937f2695 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.845895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d505f7-aa99-46c7-a40b-c41b937f2695 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.846167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d505f7-aa99-46c7-a40b-c41b937f2695 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.848013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 335/668] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:57.848641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d505f7-aa99-46c7-a40b-c41b937f2695 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:57.918194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 334/669] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:41:57.920023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ec97-2ac9-491a-abeb-511217059e48 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:57.920648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ec97-2ac9-491a-abeb-511217059e48 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:57.921146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ec97-2ac9-491a-abeb-511217059e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:57.938388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3dd1ec97-2ac9-491a-abeb-511217059e48 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:57.939589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3dd1ec97-2ac9-491a-abeb-511217059e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:57.971521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d505f7-aa99-46c7-a40b-c41b937f2695 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.009404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.010085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.010369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.010652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.011442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:58.011755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.013151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.025575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 335/670] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:58.025575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d83c00-721d-4d1f-926a-318e56a24501 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.025575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d83c00-721d-4d1f-926a-318e56a24501 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.025575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d83c00-721d-4d1f-926a-318e56a24501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.031428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 336/671] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:58.032367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.045941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-87d83c00-721d-4d1f-926a-318e56a24501 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:58.047435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-87d83c00-721d-4d1f-926a-318e56a24501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:58.127294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 336/672] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:41:58.127294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d83c00-721d-4d1f-926a-318e56a24501 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.161871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b3a03-9e06-4914-9602-db80f8d77aed None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.198082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.198867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.199142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.199409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.214001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.215864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.228272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d83c00-721d-4d1f-926a-318e56a24501 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:58.236974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:58.238745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:58.239635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:58.239635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:58.239635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:58.239635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:58.240407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 337/673] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:58.241470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.269814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.270618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.270903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.271178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.278427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.280013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:58.294396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:58.295494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:58.296391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 337/674] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:58.296899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.347481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31181810-c367-44c9-8738-31886ae8bffc None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.382341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04df74-06a2-44fc-a107-715931662f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.383130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04df74-06a2-44fc-a107-715931662f34 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.383418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04df74-06a2-44fc-a107-715931662f34 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.383692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04df74-06a2-44fc-a107-715931662f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.394412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04df74-06a2-44fc-a107-715931662f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-3b04df74-06a2-44fc-a107-715931662f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:58.402103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:58.403066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:58.403925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 338/675] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:58.404648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04df74-06a2-44fc-a107-715931662f34 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.411913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733883d7-1807-49b4-86b7-e96ed219f49e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.446671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff54839-9b69-462c-8394-26685bd5d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.447467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54839-9b69-462c-8394-26685bd5d2cb None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.447752 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54839-9b69-462c-8394-26685bd5d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.448030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54839-9b69-462c-8394-26685bd5d2cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.458631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff54839-9b69-462c-8394-26685bd5d2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-8ff54839-9b69-462c-8394-26685bd5d2cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:41:58.466387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:58.467340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:58.468153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 338/676] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:58.468832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff54839-9b69-462c-8394-26685bd5d2cb None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.509379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04df74-06a2-44fc-a107-715931662f34 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.544291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.544956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.545255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.545533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.546254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:58.546556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.548507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.561274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 339/677] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:58.562184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.578939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff54839-9b69-462c-8394-26685bd5d2cb None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.615406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.618398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.618398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.618398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.618861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:58.619313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.621847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.646406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 339/678] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:58.646406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.685696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa022e-2911-45be-bf8d-f6a7bdd9931d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.720235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.720906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.721186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.721485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.723123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:58.723540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.724906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.739625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 340/679] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:58.739625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.759112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc1371-1a7b-426b-abac-8fda80966431 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.797294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.798099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.798383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.798961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.800672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:58.800869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.802250 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.817932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 340/680] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:58.817932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.835347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1d609-9931-4ea4-8783-939a78e53dfa None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.869265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.870042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.870318 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.870588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.878116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.879562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:41:58.893710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:58.894647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:58.895510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:41:58.895510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:41:58.895510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:41:58.895510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:41:58.895510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:41:58.895510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:41:58.895510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:41:58.895510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:58.898457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 341/681] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:58.898457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.934931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5cb39-c6ee-4a68-b0ac-f99e2a28ce4b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.970790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.971467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.972394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.972673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.973657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=26d96159b7fb49c08b1f5c014d26f79b) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:58.973967 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.975446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.982643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 341/682] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/role_assignments?user.id=26d96159b7fb49c08b1f5c014d26f79b&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:58.983520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.022838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa05cc-11bf-499b-83cd-0d5eeaa9cd93 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.069892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.071088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.071622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.072273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.087065 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.088980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:59.110577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:59.111597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:59.113008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:59.113008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:59.113008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:59.113008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:59.116578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6f4f3-1412-47f7-8ead-dcfacd807f6b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.117361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 342/683] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:59.118322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.155607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.156424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.156709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.156988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.168975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.170481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:41:59.190861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:59.191921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:59.192797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:41:59.192797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:41:59.192797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:41:59.192797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:59.196825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 342/684] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:59.197844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.245123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950839a8-d3f8-4034-aa6d-c1bae587646c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.288892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.290333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.290333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.290333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.291115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:59.291232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.292716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.307369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 343/685] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:59.308579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.325131 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a669007-b8d4-4899-a567-cc12b5e908ce None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.365743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.366418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.366705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.366986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.367766 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:59.368085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.369487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.382877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 343/686] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:59.383731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.448443 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba92d-73a6-43c5-b06b-cda8b87b5d32 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.492372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.493037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.493348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.493610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d97a16-2c8d-42de-bffc-ecde6b0bd301 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.494056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.494351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:59.494661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.497011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.513323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 344/687] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:59.517262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.536639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.537388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.537674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.537953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.538804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=378bf86fc54142ee85dc16cce3664978) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:59.539118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.540564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.547115 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 344/688] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/role_assignments?user.id=378bf86fc54142ee85dc16cce3664978&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:59.548098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.647632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204997b-042e-4398-90fe-d50716ffa0c3 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.684455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.685357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.685725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.685966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.688340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64725f-e126-452b-91a3-a4ca668227a3 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.702682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.704174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:59.730103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:59.732428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:41:59.734713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:41:59.736150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 345/689] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:59.743922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.744222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.744397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.744397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.744397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] PATH_INFO: `/v3/users/swift` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.757290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.760134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:41:59.777389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:41:59.778398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:41:59.779325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:41:59.782568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 345/690] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:41:59.791066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.870680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08024a7-a316-4b7b-a396-1ad96d605cc4 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.898515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6bc7f-7c1f-4fc9-89f4-b4b79d7b482b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:59.916818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.917696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.918118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.918494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.919452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:59.919863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.921436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.938597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:59.939555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:59.939977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:59.940492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:59.941516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:41:59.941966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:59.943557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:59.947475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 346/691] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:59.952703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:59.963515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 346/692] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:41:59.969039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:00.058030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fec207-7bd7-4919-aadc-57554d9a8196 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:00.072462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fae5b6-ab28-4fd8-bebb-5f3c9eaa6228 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:00.093038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa71d4-0399-496b-9646-74e987ec92e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:00.093856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa71d4-0399-496b-9646-74e987ec92e5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.094213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa71d4-0399-496b-9646-74e987ec92e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.094601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa71d4-0399-496b-9646-74e987ec92e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.109991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b833b-6329-4327-b1da-7420bc12ed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:00.111041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b833b-6329-4327-b1da-7420bc12ed7d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.111522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b833b-6329-4327-b1da-7420bc12ed7d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.112014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b833b-6329-4327-b1da-7420bc12ed7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.171220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa71d4-0399-496b-9646-74e987ec92e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:00.172626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa71d4-0399-496b-9646-74e987ec92e5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:00.185476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b833b-6329-4327-b1da-7420bc12ed7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:00.187268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b833b-6329-4327-b1da-7420bc12ed7d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:00.275130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 347/693] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:42:00.285041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa71d4-0399-496b-9646-74e987ec92e5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:00.292340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 347/694] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:42:00.297962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b833b-6329-4327-b1da-7420bc12ed7d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:00.400539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b833b-6329-4327-b1da-7420bc12ed7d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:00.404043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa71d4-0399-496b-9646-74e987ec92e5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:00.439128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:00.440990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.441117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fed68-faf3-4d86-ab43-827fc7002b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:00.441679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.441849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fed68-faf3-4d86-ab43-827fc7002b10 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.442146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fed68-faf3-4d86-ab43-827fc7002b10 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.442407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fed68-faf3-4d86-ab43-827fc7002b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.442813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.454500 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fed68-faf3-4d86-ab43-827fc7002b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:00.454829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:00.456323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fed68-faf3-4d86-ab43-827fc7002b10 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:00.457370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-035fed68-faf3-4d86-ab43-827fc7002b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:00.476268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:00.477259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:00.478162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:00.478162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:00.478162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:00.478162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:00.478162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 348/695] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:00.479544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd350cc-c1c7-43bb-b451-86f5909c94f0 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.480145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd350cc-c1c7-43bb-b451-86f5909c94f0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.480499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd350cc-c1c7-43bb-b451-86f5909c94f0 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:00.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:00.481728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:00.482642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:00.482642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:00.482642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:00.482642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:00.482851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 349/696] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:00.484600 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 348/697] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:00.493115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00980fc3-29ac-4352-a2f5-88c78640c91b None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.493115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00980fc3-29ac-4352-a2f5-88c78640c91b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.493115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00980fc3-29ac-4352-a2f5-88c78640c91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.493649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:00.508977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-00980fc3-29ac-4352-a2f5-88c78640c91b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:00.510463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-00980fc3-29ac-4352-a2f5-88c78640c91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:00.585339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 350/698] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:42:00.586888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00980fc3-29ac-4352-a2f5-88c78640c91b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:00.611067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21804-9f84-430f-ac76-b0621ca21278 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:00.657807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:00.659067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.661022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.661413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.662247 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:00.662878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:00.665052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:00.685274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 349/699] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:00.685274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:00.714501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00980fc3-29ac-4352-a2f5-88c78640c91b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:00.754594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:00.755574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.756058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.756514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.757553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:00.758055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:00.759843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:00.777326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 351/700] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:00.778582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:00.825293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445c15d-5d34-4822-bd5c-7f95bba9533b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:00.871082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:00.871907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.872193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.872468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.873128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:00.874521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:00.891467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799f56d-2878-4d54-b213-15e381f3cdf2 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:00.896580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:00.897597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:00.898448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:00.907270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 350/701] 10.222.0.69 () {56 vars in 1129 bytes} [Wed May 4 13:42:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:00.908823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:00.933756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:00.934611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:00.934913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:00.935338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:00.944429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:00.945934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:00.961663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:00.962616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:00.963920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 352/702] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:00.964408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:01.037922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830adc4c-6f97-4328-99e3-eefbcf37848d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:01.074616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:01.075749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.075749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.076010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.083918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:01.085484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:01.090407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08d6b2-d1ea-4d3a-8ee8-ccbe18460fdd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:01.101799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:01.102809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:01.103794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:01.103794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:01.103794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:01.103794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:01.103794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:01.103794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:01.103794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:01.103794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:01.108844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 351/703] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:01.109810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:01.136916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:01.138168 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.138825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.139287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.140733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:01.141250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:01.143350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:01.155593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 353/704] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 13:42:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:01.156817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:01.225225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9299a-9a6c-4212-806a-59ada960951b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:01.262776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:01.263347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.263698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.264117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.264912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:01.265318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:01.266823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e866-c986-40bd-9885-e5168ed90070 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:01.267011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:01.286000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 352/705] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:01.287059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:01.304150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:01.305448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.305953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.306451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.307509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:01.308066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:01.309886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:01.323381 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 354/706] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:01.324637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:01.404324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb4c25-632d-406f-b716-8b4b35199308 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:01.427187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942e3e-d97d-416d-96ff-0e5924ab889b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:01.443405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:01.444014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.444296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.444568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.445528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:01.445732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:01.447227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:01.460754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 353/707] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 13:42:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:01.461972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:01.469843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82d2de-db28-46fb-9c1a-2531a24e560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:01.470899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d2de-db28-46fb-9c1a-2531a24e560a None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.471535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d2de-db28-46fb-9c1a-2531a24e560a None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.472062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82d2de-db28-46fb-9c1a-2531a24e560a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.473163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82d2de-db28-46fb-9c1a-2531a24e560a None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=f6da21ec482e47399411baa3c33f4f21) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:01.473786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82d2de-db28-46fb-9c1a-2531a24e560a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:01.475568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82d2de-db28-46fb-9c1a-2531a24e560a None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:01.482857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 355/708] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:01 2022] GET /identity/v3/role_assignments?user.id=f6da21ec482e47399411baa3c33f4f21&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=f1d6bdc882c24a2a9389961135865317 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:01.679903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0e2e-f7ce-49b8-bb28-613f23aebc91 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.681074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0e2e-f7ce-49b8-bb28-613f23aebc91 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.681639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0e2e-f7ce-49b8-bb28-613f23aebc91 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.687635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 356/709] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:01.689654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aad11-e217-4d7d-91fe-6b2585698f80 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.690227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aad11-e217-4d7d-91fe-6b2585698f80 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.691243 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aad11-e217-4d7d-91fe-6b2585698f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.726487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7d8aad11-e217-4d7d-91fe-6b2585698f80 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:01.727744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7d8aad11-e217-4d7d-91fe-6b2585698f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:01.733229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e2e6f-0f9e-4c87-ae50-e83685008c5d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:01.776030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:01.776760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.777079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.777390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.778294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=52aa32e8c0f742659725ddec932014b8) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:01.778612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:01.780079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:01.788282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 354/710] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:01 2022] GET /identity/v3/role_assignments?user.id=52aa32e8c0f742659725ddec932014b8&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:01.849532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 357/711] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:42:01.880392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:02.010635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1fa19-f020-4b86-a149-180711f8aa83 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:02.050284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:02.051851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:02.052191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:02.052473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:02.069504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:02.070968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:02.100913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:02.101911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:02.102780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:02.102780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:02.102780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:02.102780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:02.102780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 355/712] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:02.109920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aad11-e217-4d7d-91fe-6b2585698f80 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:02.232894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aad11-e217-4d7d-91fe-6b2585698f80 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:02.276373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db236b-8cd0-4250-9705-4873ed46cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:02.276967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db236b-8cd0-4250-9705-4873ed46cc73 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:02.277262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db236b-8cd0-4250-9705-4873ed46cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:02.277553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db236b-8cd0-4250-9705-4873ed46cc73 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:02.278287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db236b-8cd0-4250-9705-4873ed46cc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:02.278595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db236b-8cd0-4250-9705-4873ed46cc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:02.280047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db236b-8cd0-4250-9705-4873ed46cc73 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:02.293228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 358/713] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:02.298670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:02.410151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48551fb-8de5-4960-bc7b-db8ee4be189f None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:02.450781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587310-d87e-414e-b5a9-50238aa9b0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:02.451775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587310-d87e-414e-b5a9-50238aa9b0c4 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:02.452257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587310-d87e-414e-b5a9-50238aa9b0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:02.452708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587310-d87e-414e-b5a9-50238aa9b0c4 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:02.453654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31587310-d87e-414e-b5a9-50238aa9b0c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:02.455281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31587310-d87e-414e-b5a9-50238aa9b0c4 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:02.458591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889954ec-07a6-4570-977f-e4fbae11acfa None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:02.458908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889954ec-07a6-4570-977f-e4fbae11acfa None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:02.459188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889954ec-07a6-4570-977f-e4fbae11acfa None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:02.460551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 359/714] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:02.466578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1097fe-fa26-4655-8fd0-02a1202dec5c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:02.466797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1097fe-fa26-4655-8fd0-02a1202dec5c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:02.467052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1097fe-fa26-4655-8fd0-02a1202dec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:02.486165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5a1097fe-fa26-4655-8fd0-02a1202dec5c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:02.487499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5a1097fe-fa26-4655-8fd0-02a1202dec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:02.564383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 360/715] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:42:02.575975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 356/716] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:42:02 2022] POST /identity/v3/users => generated 254 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:02.585689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1097fe-fa26-4655-8fd0-02a1202dec5c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:02.701313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1097fe-fa26-4655-8fd0-02a1202dec5c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:02.739432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:02.740241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:02.740528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:02.740837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] PATH_INFO: `/v3/services/network` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:02.741537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:02.743012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:02.757749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:02.758810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:02.760148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:02.764056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 361/717] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:02 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:02.765531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587310-d87e-414e-b5a9-50238aa9b0c4 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:02.883595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587310-d87e-414e-b5a9-50238aa9b0c4 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:02.920751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e77edf-e9b9-49b2-986b-2f9c14239d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:02.921477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77edf-e9b9-49b2-986b-2f9c14239d0f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:02.921761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77edf-e9b9-49b2-986b-2f9c14239d0f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:02.922090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77edf-e9b9-49b2-986b-2f9c14239d0f None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:02.922820 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e77edf-e9b9-49b2-986b-2f9c14239d0f None admin] RBAC: Adding query filter params (name=network) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:02.923126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e77edf-e9b9-49b2-986b-2f9c14239d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:02.924495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e77edf-e9b9-49b2-986b-2f9c14239d0f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:02.933596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 357/718] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:02.935758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:03.042380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693618-0d61-49f5-9730-2e21a2a32705 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:03.076507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b128e-74b7-428b-85cf-240ecd2ced95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:03.077179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b128e-74b7-428b-85cf-240ecd2ced95 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:03.077499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b128e-74b7-428b-85cf-240ecd2ced95 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:03.077779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b128e-74b7-428b-85cf-240ecd2ced95 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:03.078495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b128e-74b7-428b-85cf-240ecd2ced95 None admin] RBAC: Adding query filter params (type=network) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:03.078803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b128e-74b7-428b-85cf-240ecd2ced95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:03.080235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b128e-74b7-428b-85cf-240ecd2ced95 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:03.089379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 362/719] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:04.268399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e84e7-be1d-4114-bc51-5f086ec50bdc None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:04.268978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e84e7-be1d-4114-bc51-5f086ec50bdc None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:04.268978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e84e7-be1d-4114-bc51-5f086ec50bdc None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:04.270663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 358/720] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:04.276322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557c92-2479-4272-937d-51d1c906f858 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:04.276743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557c92-2479-4272-937d-51d1c906f858 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:04.276919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557c92-2479-4272-937d-51d1c906f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:04.296083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a9557c92-2479-4272-937d-51d1c906f858 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:04.297304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a9557c92-2479-4272-937d-51d1c906f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:04.390908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 363/721] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:42:04.414035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e84e7-be1d-4114-bc51-5f086ec50bdc None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:04.517781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e84e7-be1d-4114-bc51-5f086ec50bdc None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:04.571064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf252da4-09f5-4e3d-809c-06e3c4830488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:04.572234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf252da4-09f5-4e3d-809c-06e3c4830488 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:04.572714 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf252da4-09f5-4e3d-809c-06e3c4830488 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:04.573184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf252da4-09f5-4e3d-809c-06e3c4830488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:04.590025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dad89-7aa0-4f78-b4a8-0fbda8ebe138 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:04.590319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dad89-7aa0-4f78-b4a8-0fbda8ebe138 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:04.590587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dad89-7aa0-4f78-b4a8-0fbda8ebe138 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:04.592206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 364/722] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:04.593301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf252da4-09f5-4e3d-809c-06e3c4830488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:04.597642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19ab1-8211-4120-8c33-fdbbd4e8be11 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:04.597929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19ab1-8211-4120-8c33-fdbbd4e8be11 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:04.598212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19ab1-8211-4120-8c33-fdbbd4e8be11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-cf252da4-09f5-4e3d-809c-06e3c4830488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:04.602106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:04.603053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:04.603886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:04.607671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 359/723] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:04.617533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf252da4-09f5-4e3d-809c-06e3c4830488 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:04.622982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-cde19ab1-8211-4120-8c33-fdbbd4e8be11 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:04.624405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-cde19ab1-8211-4120-8c33-fdbbd4e8be11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:04.741892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 365/724] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:42:04.786413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde19ab1-8211-4120-8c33-fdbbd4e8be11 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:04.810754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf252da4-09f5-4e3d-809c-06e3c4830488 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:04.880898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5928501-480a-4bd7-afff-7dab9375e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:04.881981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5928501-480a-4bd7-afff-7dab9375e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:04.882466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5928501-480a-4bd7-afff-7dab9375e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:04.882942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5928501-480a-4bd7-afff-7dab9375e7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:04.883944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5928501-480a-4bd7-afff-7dab9375e7e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:04.884448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5928501-480a-4bd7-afff-7dab9375e7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:04.886118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5928501-480a-4bd7-afff-7dab9375e7e6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:04.895603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 360/725] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:04.897171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91009-5097-4ba6-b264-13e01e323203 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:04.897710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91009-5097-4ba6-b264-13e01e323203 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:04.898182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91009-5097-4ba6-b264-13e01e323203 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:04.899902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 361/726] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:04.900800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c91009-5097-4ba6-b264-13e01e323203 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:04.944440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde19ab1-8211-4120-8c33-fdbbd4e8be11 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:04.981100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384ec5-ef93-40bf-8617-0be23238aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:04.982136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384ec5-ef93-40bf-8617-0be23238aa90 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:04.982603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384ec5-ef93-40bf-8617-0be23238aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:04.983060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384ec5-ef93-40bf-8617-0be23238aa90 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:04.983970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384ec5-ef93-40bf-8617-0be23238aa90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:04.985575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384ec5-ef93-40bf-8617-0be23238aa90 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:05.010633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c91009-5097-4ba6-b264-13e01e323203 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:05.046627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed96bf-cc17-43ab-8ec4-dc7de9a9fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:05.047439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed96bf-cc17-43ab-8ec4-dc7de9a9fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.047708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed96bf-cc17-43ab-8ec4-dc7de9a9fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.047984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed96bf-cc17-43ab-8ec4-dc7de9a9fbd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.060128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed96bf-cc17-43ab-8ec4-dc7de9a9fbd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:05.061065 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed96bf-cc17-43ab-8ec4-dc7de9a9fbd3 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-e5ed96bf-cc17-43ab-8ec4-dc7de9a9fbd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:05.078993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:05.080004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:05.086368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:05.086368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:05.086368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:05.086368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:05.086368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 362/727] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:05.086368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f506-3a24-4a9e-8e59-14d2df811393 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.086368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f506-3a24-4a9e-8e59-14d2df811393 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.086368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f506-3a24-4a9e-8e59-14d2df811393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.099139 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 366/728] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:42:04 2022] POST /identity/v3/services => generated 251 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:42:05.101387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384ec5-ef93-40bf-8617-0be23238aa90 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:05.105701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-91e3f506-3a24-4a9e-8e59-14d2df811393 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:05.107287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-91e3f506-3a24-4a9e-8e59-14d2df811393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:05.249056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 363/729] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:42:05.255023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384ec5-ef93-40bf-8617-0be23238aa90 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:05.285290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3f506-3a24-4a9e-8e59-14d2df811393 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:05.303101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:05.303795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.304086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.304367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.305170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:05.306954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:05.308489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:05.328936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 367/730] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:05.334606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:05.433871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3f506-3a24-4a9e-8e59-14d2df811393 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:05.475094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb051d62-4d4a-43e9-b817-6edb15c44e48 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:05.478832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa8e7f-8bd1-4231-a795-36057e6d67cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:05.479644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa8e7f-8bd1-4231-a795-36057e6d67cf None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.480185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa8e7f-8bd1-4231-a795-36057e6d67cf None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.480467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa8e7f-8bd1-4231-a795-36057e6d67cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.494707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa8e7f-8bd1-4231-a795-36057e6d67cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-5cfa8e7f-8bd1-4231-a795-36057e6d67cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:05.505294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:05.506263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:05.507080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 364/731] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:05.514284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa8e7f-8bd1-4231-a795-36057e6d67cf None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:05.517088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:05.518162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.518586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.518937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.527539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:05.529151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:05.544248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:05.545225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:05.546178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 368/732] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:42:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:05.551657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:05.663740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa8e7f-8bd1-4231-a795-36057e6d67cf None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:05.691420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288378bf-834d-46fc-b93d-04069ba9417a None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:05.731465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:05.732156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.732442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.732722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.733614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:05.733929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:05.735379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:05.753276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:05.754022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.756998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.756998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.756998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:05.756998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:05.756998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:05.774023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 369/733] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:42:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:05.779716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 365/734] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:05.779901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:05.787034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:05.926190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cf8eb-9235-49bf-ba46-9f100559d060 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:05.929584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf18418-3b40-499a-a0e1-edeca1364f72 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:05.961390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77b2dc-65fa-4042-991f-6d1604220ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:05.962186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b2dc-65fa-4042-991f-6d1604220ebd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.962468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b2dc-65fa-4042-991f-6d1604220ebd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.962766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77b2dc-65fa-4042-991f-6d1604220ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.964414 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51517f2d-50cc-47c4-b0eb-ddbf34173902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:05.965474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51517f2d-50cc-47c4-b0eb-ddbf34173902 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:05.965951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51517f2d-50cc-47c4-b0eb-ddbf34173902 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:05.966415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51517f2d-50cc-47c4-b0eb-ddbf34173902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:05.973688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77b2dc-65fa-4042-991f-6d1604220ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:05.975153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77b2dc-65fa-4042-991f-6d1604220ebd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:05.978060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51517f2d-50cc-47c4-b0eb-ddbf34173902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:05.979716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51517f2d-50cc-47c4-b0eb-ddbf34173902 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-ee77b2dc-65fa-4042-991f-6d1604220ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:05.994096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:05.995087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:05.995953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:05.995953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:05.995953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:05.995953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:05.996769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 370/735] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-51517f2d-50cc-47c4-b0eb-ddbf34173902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:05.997787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:05.998682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:06.000202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:06.000202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:06.000202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:06.000202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:06.001208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611969e-a641-4c9e-8e15-42843c271ce0 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.001599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611969e-a641-4c9e-8e15-42843c271ce0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.001935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611969e-a641-4c9e-8e15-42843c271ce0 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.003542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 366/736] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:06.003948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 371/737] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:06.004600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611969e-a641-4c9e-8e15-42843c271ce0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.004903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc95995-2e1f-4b7b-9486-f0722c9e2e0a None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.005187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc95995-2e1f-4b7b-9486-f0722c9e2e0a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.008230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc95995-2e1f-4b7b-9486-f0722c9e2e0a None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.008230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 367/738] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:06.008230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc95995-2e1f-4b7b-9486-f0722c9e2e0a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.110708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc95995-2e1f-4b7b-9486-f0722c9e2e0a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.111686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611969e-a641-4c9e-8e15-42843c271ce0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.145031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df134e-0e38-4bdb-95d7-c2d50d068702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.145877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df134e-0e38-4bdb-95d7-c2d50d068702 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.146216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df134e-0e38-4bdb-95d7-c2d50d068702 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.146470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df134e-0e38-4bdb-95d7-c2d50d068702 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.147167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df134e-0e38-4bdb-95d7-c2d50d068702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:06.147477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df134e-0e38-4bdb-95d7-c2d50d068702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.147635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b453b-9d68-4063-a173-ad33b99dbd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.148264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b453b-9d68-4063-a173-ad33b99dbd61 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.148546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b453b-9d68-4063-a173-ad33b99dbd61 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.148820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b453b-9d68-4063-a173-ad33b99dbd61 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.148914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df134e-0e38-4bdb-95d7-c2d50d068702 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.149587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b453b-9d68-4063-a173-ad33b99dbd61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:06.149895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b453b-9d68-4063-a173-ad33b99dbd61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.151365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b453b-9d68-4063-a173-ad33b99dbd61 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.162190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 368/739] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:06.167767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9b85-6318-461b-a90b-2c9668b75209 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.167767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9b85-6318-461b-a90b-2c9668b75209 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.167767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9b85-6318-461b-a90b-2c9668b75209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.168259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 372/740] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:06.169857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29374f-ec0a-4c48-87bd-64909df58d78 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.170313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29374f-ec0a-4c48-87bd-64909df58d78 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.170596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29374f-ec0a-4c48-87bd-64909df58d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.182059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3c9e9b85-6318-461b-a90b-2c9668b75209 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:06.183271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3c9e9b85-6318-461b-a90b-2c9668b75209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:06.187759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ab29374f-ec0a-4c48-87bd-64909df58d78 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:06.188925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ab29374f-ec0a-4c48-87bd-64909df58d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:06.254783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 369/741] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:42:06.255982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9b85-6318-461b-a90b-2c9668b75209 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.273011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 373/742] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:42:06.274432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29374f-ec0a-4c48-87bd-64909df58d78 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.359434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9b85-6318-461b-a90b-2c9668b75209 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.390455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29374f-ec0a-4c48-87bd-64909df58d78 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.395638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.396463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.396808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.397112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.404691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.406365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:06.421999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:06.423007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:06.423960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 370/743] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:06.424557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.431412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.432256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.432537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.432849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.440322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.441902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:06.456853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:06.458144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 374/744] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:06.459018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.532001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce9be7-63da-4867-9112-1f03dabb781a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.567249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451effab-3526-4f51-a371-19d3d47eec0d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.569129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c35cac-9fa2-425c-bcbb-71fc2596c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.569965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c35cac-9fa2-425c-bcbb-71fc2596c785 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.570370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c35cac-9fa2-425c-bcbb-71fc2596c785 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.570650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c35cac-9fa2-425c-bcbb-71fc2596c785 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.582728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c35cac-9fa2-425c-bcbb-71fc2596c785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-01c35cac-9fa2-425c-bcbb-71fc2596c785 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:06.590721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:06.591681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:06.592524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 371/745] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:06.593610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c35cac-9fa2-425c-bcbb-71fc2596c785 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.608527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084a05-b728-44cc-812b-0879d4307f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.609522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084a05-b728-44cc-812b-0879d4307f45 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.614298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084a05-b728-44cc-812b-0879d4307f45 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.614298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084a05-b728-44cc-812b-0879d4307f45 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.614298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084a05-b728-44cc-812b-0879d4307f45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.614298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084a05-b728-44cc-812b-0879d4307f45 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.703241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c35cac-9fa2-425c-bcbb-71fc2596c785 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.739086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.739753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.740037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.740316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.741169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:06.744179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.744179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.769550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 375/746] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:42:06 2022] POST /identity/v3/services => generated 240 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:06.769550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084a05-b728-44cc-812b-0879d4307f45 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.769856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 372/747] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:06.769856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.897227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2970d52-3de0-4a95-9345-0d6e46ca7f77 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.911028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084a05-b728-44cc-812b-0879d4307f45 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.934159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.934845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.935124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.935395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.936150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:06.936448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.937866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.949317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 373/748] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:06.953617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.953917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.955234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.955688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.956489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.957536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:06.958082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.959730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.973558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 376/749] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:06.974566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:07.068229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2b48e-a72e-4c59-b6fd-eee03de94225 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:07.090405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc7d4a-9c19-4e01-8151-76908336870e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:07.103986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948899f-53cb-4aa0-a3c6-8d1de29b78a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:07.105327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948899f-53cb-4aa0-a3c6-8d1de29b78a7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.105834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948899f-53cb-4aa0-a3c6-8d1de29b78a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.106311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948899f-53cb-4aa0-a3c6-8d1de29b78a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.125895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:07.126704 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.127147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.127255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.138999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:07.140464 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:07.158201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:07.159760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:07.160715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:07.160715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:07.160715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:07.160715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:07.160715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 377/750] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:07.161538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:07.183417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948899f-53cb-4aa0-a3c6-8d1de29b78a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:07.185299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948899f-53cb-4aa0-a3c6-8d1de29b78a7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:07.266797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045953-653c-46f7-bf18-ee7f95ac40c9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:07.290034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 374/751] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:07.291208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948899f-53cb-4aa0-a3c6-8d1de29b78a7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:07.303103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc587-f308-4524-83b2-15b914e77ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:07.304002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc587-f308-4524-83b2-15b914e77ff9 None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.304291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc587-f308-4524-83b2-15b914e77ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.304743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc587-f308-4524-83b2-15b914e77ff9 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/f6da21ec482e47399411baa3c33f4f21/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.308954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecc587-f308-4524-83b2-15b914e77ff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=f6da21ec482e47399411baa3c33f4f21, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:07.311205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecc587-f308-4524-83b2-15b914e77ff9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:07.397501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 378/752] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:42:07 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/f6da21ec482e47399411baa3c33f4f21/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:42:07.398625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc587-f308-4524-83b2-15b914e77ff9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:07.404403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948899f-53cb-4aa0-a3c6-8d1de29b78a7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:07.449375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:07.450421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.450941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.451442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.452975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:07.453529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:07.455632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:07.471223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 375/753] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:07.477338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:07.632028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687234bc-7294-4ba9-8443-4654a23adb61 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:07.650136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc587-f308-4524-83b2-15b914e77ff9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:07.700104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:07.701021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.701329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.701604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.701865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:07.702666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.703011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.703277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.717452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:07.718364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:07.719187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:07.720291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:07.739291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:07.740383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:07.741950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 376/754] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:42:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:07.743895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:07.744803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:07.746188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:07.746188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:07.746188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:07.746188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:07.746634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:07.748486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 379/755] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:07.755853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:07.862817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dd6de-eb2b-410c-adb9-56a08540f551 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:07.903601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e1ca4-2626-4b76-a9f8-e5ea868b7931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:07.904646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1ca4-2626-4b76-a9f8-e5ea868b7931 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.904949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1ca4-2626-4b76-a9f8-e5ea868b7931 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.905232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1ca4-2626-4b76-a9f8-e5ea868b7931 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.906285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e1ca4-2626-4b76-a9f8-e5ea868b7931 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:07.906601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e1ca4-2626-4b76-a9f8-e5ea868b7931 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:07.908357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e1ca4-2626-4b76-a9f8-e5ea868b7931 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:07.923370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df9cb-2fd1-4222-80c7-9512f805ec44 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:07.934210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 377/756] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 13:42:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:07.935648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd6a4-7c24-4ded-8d8c-16d4876a3d31 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.935944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd6a4-7c24-4ded-8d8c-16d4876a3d31 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.936224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bd6a4-7c24-4ded-8d8c-16d4876a3d31 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.937759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 378/757] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:07.942258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bd6a4-7c24-4ded-8d8c-16d4876a3d31 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:07.973450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02b9c9-7935-4e02-8eb5-745d7d75323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:07.974095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02b9c9-7935-4e02-8eb5-745d7d75323d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.974380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02b9c9-7935-4e02-8eb5-745d7d75323d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.974657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02b9c9-7935-4e02-8eb5-745d7d75323d None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:07.975391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02b9c9-7935-4e02-8eb5-745d7d75323d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:07.975753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02b9c9-7935-4e02-8eb5-745d7d75323d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:07.977134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02b9c9-7935-4e02-8eb5-745d7d75323d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:07.990720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 380/758] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:07.992236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b410-0cfb-4f51-b7b1-a4edcced31e4 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:07.992525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b410-0cfb-4f51-b7b1-a4edcced31e4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:07.992801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b410-0cfb-4f51-b7b1-a4edcced31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.009937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-6c10b410-0cfb-4f51-b7b1-a4edcced31e4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:08.011235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6c10b410-0cfb-4f51-b7b1-a4edcced31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:08.078176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bd6a4-7c24-4ded-8d8c-16d4876a3d31 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.083953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 381/759] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:08.084932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b410-0cfb-4f51-b7b1-a4edcced31e4 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.135142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe27fb-2746-4581-8990-489f13555398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.135797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe27fb-2746-4581-8990-489f13555398 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.136085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe27fb-2746-4581-8990-489f13555398 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.136365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe27fb-2746-4581-8990-489f13555398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.205056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe27fb-2746-4581-8990-489f13555398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.207260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe27fb-2746-4581-8990-489f13555398 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:08.220532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b410-0cfb-4f51-b7b1-a4edcced31e4 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.260032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.260751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.261035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.261340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.269271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.270801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:08.285298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:08.287489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 382/760] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:08.289667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.324386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 379/761] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:08.325270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe27fb-2746-4581-8990-489f13555398 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.393772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95293b-deae-4ae1-ad92-d5c1637ddb6e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.429078 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.429940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.430226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.430505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.431181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.432675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:08.445648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:08.447969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:08.450132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:08.452135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe27fb-2746-4581-8990-489f13555398 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.461309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 383/762] 10.222.0.69 () {56 vars in 1129 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:08.461309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.491850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.492516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.492799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.493074 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.493971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:08.494280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.495768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:08.509122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 380/763] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:08.510015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.556617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5853b05-5d8b-4d80-aeae-5ba6289ef188 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.591291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.592090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.592373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.592645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.605273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.606777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:08.616273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ecbd-fed5-412d-9de2-f55d9d9c48c9 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:08.624897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:08.627119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:08.630039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:08.630039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:08.630039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:08.630039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:08.630039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 384/764] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:08.630039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.658009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.658749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.659804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.660311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.661132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:08.661480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.662871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:08.668528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 381/765] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:08.669579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.851525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696441a-6973-4daa-9b71-d5dbd51c958d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.894858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.896004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.896427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.896866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.897547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf341d-301e-4cf7-a36f-4b82b5ff816b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.898030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=52aa32e8c0f742659725ddec932014b8) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:08.898481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.901003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:08.910195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 385/766] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/role_assignments?user.id=52aa32e8c0f742659725ddec932014b8&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=f1d6bdc882c24a2a9389961135865317 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:08.912822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.966495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.967427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.967907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.968355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.969298 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:08.969792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.972757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:09.005772 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 382/767] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:09.008646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:09.110551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df9a53-1101-4551-b872-82a1c9757b4d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:09.156920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:09.157624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.157908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.158185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.159116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:09.159586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:09.161202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:09.172504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 386/768] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:09.173493 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:09.189758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643aba5-6896-413f-b661-7f8273bebecc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:09.256946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:09.257779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.258058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.258321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.269404 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:09.271041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:09.297490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:09.299019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:09.301286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:09.301286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:09.301286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:09.301286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:09.301286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:09.301286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:09.301286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:09.301286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:09.309365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 383/769] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:09.312072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:09.334999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77125f4b-dc1d-4eaa-a75c-9a12c87005a9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:09.385489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b29d1f-ab3a-4b98-a82c-213464b7e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:09.386406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29d1f-ab3a-4b98-a82c-213464b7e07d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.386720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29d1f-ab3a-4b98-a82c-213464b7e07d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.387455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b29d1f-ab3a-4b98-a82c-213464b7e07d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.388436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b29d1f-ab3a-4b98-a82c-213464b7e07d None admin] RBAC: Adding query filter params (interface=public, service_id=5b49130c9d2e455aa523592d56b41c72, region_id=RegionOne) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:09.388825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b29d1f-ab3a-4b98-a82c-213464b7e07d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:09.391964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b29d1f-ab3a-4b98-a82c-213464b7e07d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:09.405630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 387/770] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 13:42:09 2022] GET /identity/v3/endpoints?service_id=5b49130c9d2e455aa523592d56b41c72&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:09.407525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb0cc-4a78-45bc-be37-63d16c98dd77 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.407816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb0cc-4a78-45bc-be37-63d16c98dd77 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.408097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb0cc-4a78-45bc-be37-63d16c98dd77 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.410252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 388/771] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:09.411127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb0cc-4a78-45bc-be37-63d16c98dd77 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:09.451010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65dc2a-3a8e-471d-952f-f3415752f626 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:09.499983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a3954-7589-4bcf-b120-72c22cdb6d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:09.501156 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3954-7589-4bcf-b120-72c22cdb6d58 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.501576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3954-7589-4bcf-b120-72c22cdb6d58 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.502144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a3954-7589-4bcf-b120-72c22cdb6d58 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.504225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a3954-7589-4bcf-b120-72c22cdb6d58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:09.504669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a3954-7589-4bcf-b120-72c22cdb6d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:09.506327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a3954-7589-4bcf-b120-72c22cdb6d58 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:09.525545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 384/772] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:09.527901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d555-07ef-4228-9ff4-808787aa7349 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.528217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d555-07ef-4228-9ff4-808787aa7349 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.528534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d555-07ef-4228-9ff4-808787aa7349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.536043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb0cc-4a78-45bc-be37-63d16c98dd77 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:09.552406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4cd5d555-07ef-4228-9ff4-808787aa7349 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:09.554168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4cd5d555-07ef-4228-9ff4-808787aa7349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:09.571504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab3657-de8e-43a8-bc6f-f408728f71db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:09.572348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3657-de8e-43a8-bc6f-f408728f71db None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.572728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3657-de8e-43a8-bc6f-f408728f71db None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.573099 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3657-de8e-43a8-bc6f-f408728f71db None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.574071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab3657-de8e-43a8-bc6f-f408728f71db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:09.575591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab3657-de8e-43a8-bc6f-f408728f71db None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:09.581975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 389/773] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:42:09 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:09.582948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab3657-de8e-43a8-bc6f-f408728f71db None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:09.660576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 385/774] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:09.702056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab3657-de8e-43a8-bc6f-f408728f71db None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:09.715447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d555-07ef-4228-9ff4-808787aa7349 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:09.744389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:09.744389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.744389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.744389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.745182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=d58026a187ef48d69fa18853db63cd43) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:09.745182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:09.749275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:09.756211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 390/775] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:09 2022] GET /identity/v3/role_assignments?user.id=d58026a187ef48d69fa18853db63cd43&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:09.880445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d555-07ef-4228-9ff4-808787aa7349 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:09.920209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:09.920967 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:09.921278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:09.921552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] PATH_INFO: `/v3/services/network` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:09.922245 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:09.923703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:09.939236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:09.940891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:09.942264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 386/776] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:09 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:09.947554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:10.069165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9537c-98b0-475e-a847-a54144f392d5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:10.103823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514385d1-fe0d-43f3-9195-d45f0d73a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:10.104500 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514385d1-fe0d-43f3-9195-d45f0d73a90b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.105307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514385d1-fe0d-43f3-9195-d45f0d73a90b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.105585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514385d1-fe0d-43f3-9195-d45f0d73a90b None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.106297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514385d1-fe0d-43f3-9195-d45f0d73a90b None admin] RBAC: Adding query filter params (name=network) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:10.106597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514385d1-fe0d-43f3-9195-d45f0d73a90b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:10.107953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514385d1-fe0d-43f3-9195-d45f0d73a90b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:10.113254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 391/777] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:10.122628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:10.139770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87743f-f4d7-4fe5-9094-162df145b91b None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.139770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87743f-f4d7-4fe5-9094-162df145b91b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.140258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87743f-f4d7-4fe5-9094-162df145b91b None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.141749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 392/778] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:10.147737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce0a3b-b4b4-471e-a7de-9ddfa97bed6e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.148166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce0a3b-b4b4-471e-a7de-9ddfa97bed6e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.148329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce0a3b-b4b4-471e-a7de-9ddfa97bed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.172230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3bce0a3b-b4b4-471e-a7de-9ddfa97bed6e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:10.173377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3bce0a3b-b4b4-471e-a7de-9ddfa97bed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:10.254681 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 393/779] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:10.291067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce0a3b-b4b4-471e-a7de-9ddfa97bed6e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:10.360256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac48181-6c80-478d-999c-e175bce592b1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:10.402289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:10.403387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.403892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.404368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.405981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] RBAC: Adding query filter params (type=network) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:10.406522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:10.408104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:10.414122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 387/780] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:10.419759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:10.463451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce0a3b-b4b4-471e-a7de-9ddfa97bed6e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:10.535515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852104d3-b714-4268-bdf2-ee6cad5a667d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:10.554071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801b08-f437-495f-b301-7e1d0626e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:10.554961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801b08-f437-495f-b301-7e1d0626e091 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.555195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801b08-f437-495f-b301-7e1d0626e091 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.555476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801b08-f437-495f-b301-7e1d0626e091 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.576819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:10.577896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.578384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.578858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.579924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] RBAC: Adding query filter params (interface=public, service_id=96365257b93e4331a15072e9f14a569e, region_id=RegionOne) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:10.580446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:10.582358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4801b08-f437-495f-b301-7e1d0626e091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:10.583472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:10.594242 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 388/781] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 13:42:10 2022] GET /identity/v3/endpoints?service_id=96365257b93e4331a15072e9f14a569e&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:10.599623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-d4801b08-f437-495f-b301-7e1d0626e091 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:10.600441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:10.601389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:10.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:10.609574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 394/782] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:10.614457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801b08-f437-495f-b301-7e1d0626e091 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:10.735895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46a335-c0f9-472f-b50e-c96f702d6f9d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:10.802487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d832b3-113d-4efd-a4f0-daa000da9206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:10.803176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d832b3-113d-4efd-a4f0-daa000da9206 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.803457 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d832b3-113d-4efd-a4f0-daa000da9206 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.803909 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d832b3-113d-4efd-a4f0-daa000da9206 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.804615 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d832b3-113d-4efd-a4f0-daa000da9206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:10.806916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d832b3-113d-4efd-a4f0-daa000da9206 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:10.818310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 389/783] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:42:10 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:10.880738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801b08-f437-495f-b301-7e1d0626e091 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:10.931410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:10.932102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.932387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.932665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.933535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:10.933799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:10.935183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:10.949658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 395/784] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:10.955452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d832b3-113d-4efd-a4f0-daa000da9206 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:11.141649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d832b3-113d-4efd-a4f0-daa000da9206 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:11.180458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:11.181282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:11.181591 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:11.181871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:11.194266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:11.195724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:11.215628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:11.216651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:11.217625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:11.217625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:11.217625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:11.217625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:11.217625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 390/785] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:11.225125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:11.384744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f126441-5d9b-44e8-a336-f137b08db7c4 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:11.435241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90159198-c5a5-4d04-bc8d-ddf4178b7d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:11.435856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90159198-c5a5-4d04-bc8d-ddf4178b7d71 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:11.436135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90159198-c5a5-4d04-bc8d-ddf4178b7d71 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:11.436410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90159198-c5a5-4d04-bc8d-ddf4178b7d71 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:11.437159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90159198-c5a5-4d04-bc8d-ddf4178b7d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:11.437492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90159198-c5a5-4d04-bc8d-ddf4178b7d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:11.438924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90159198-c5a5-4d04-bc8d-ddf4178b7d71 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:11.458188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 396/786] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:11.463475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:11.617370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31eae7-fd73-4da8-93de-4eecd876dff6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:11.652782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:11.653621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:11.653950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:11.654229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:11.670410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:11.671872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:11.685352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d14a-9f6f-44fc-b2cd-a4e5b8b386c7 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:11.685352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d14a-9f6f-44fc-b2cd-a4e5b8b386c7 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:11.685352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d14a-9f6f-44fc-b2cd-a4e5b8b386c7 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:11.689336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 397/787] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:11.690878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:11.691784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:11.692798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:11.695518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c50360-933f-455d-a265-6c89a5acecd8 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:11.695815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c50360-933f-455d-a265-6c89a5acecd8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:11.696094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c50360-933f-455d-a265-6c89a5acecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:11.697278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 391/788] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:42:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:11.702733 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:11.726400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-07c50360-933f-455d-a265-6c89a5acecd8 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:11.727588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-07c50360-933f-455d-a265-6c89a5acecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:11.817771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e32c9-6484-4851-bed0-1d999c1e5260 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:11.857955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:11.858635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:11.858912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:11.859217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:11.860029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:11.860333 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:11.861806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:11.885666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 392/789] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:42:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:11.887125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:11.895511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 398/790] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:11.947570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c50360-933f-455d-a265-6c89a5acecd8 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:12.063695 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c50360-933f-455d-a265-6c89a5acecd8 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:12.071444 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f920fc-8f46-4b1c-8bbc-2d2743877cf4 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:12.103533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db316c-cbd3-429f-be44-aca3adf3046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:12.104938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db316c-cbd3-429f-be44-aca3adf3046d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.105872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db316c-cbd3-429f-be44-aca3adf3046d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.106333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db316c-cbd3-429f-be44-aca3adf3046d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.118466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db316c-cbd3-429f-be44-aca3adf3046d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-43db316c-cbd3-429f-be44-aca3adf3046d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:12.127105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:12.128678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:12.129574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:12.132913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 399/791] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:12.139065 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db316c-cbd3-429f-be44-aca3adf3046d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:12.162185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07486ff-dc9b-4d5b-8d68-360491304dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:12.163402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07486ff-dc9b-4d5b-8d68-360491304dbb None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.164052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07486ff-dc9b-4d5b-8d68-360491304dbb None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.164641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07486ff-dc9b-4d5b-8d68-360491304dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.257092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db316c-cbd3-429f-be44-aca3adf3046d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:12.300383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:12.301656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.302127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.302586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.303528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:12.304562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:12.306219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:12.316969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 400/792] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:12.323417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:12.357027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07486ff-dc9b-4d5b-8d68-360491304dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:12.360067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07486ff-dc9b-4d5b-8d68-360491304dbb None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:12.480933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 393/793] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 13:42:12.490026 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7438-cf1a-478a-b0ac-56e8a1c2fe55 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.490925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7438-cf1a-478a-b0ac-56e8a1c2fe55 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.491415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7438-cf1a-478a-b0ac-56e8a1c2fe55 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.493340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 394/794] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:12.494344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b7438-cf1a-478a-b0ac-56e8a1c2fe55 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:12.529561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6163c8-87ac-4e0a-8b81-32022ed830d1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:12.569422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88695b-46db-467d-9175-b5dde822fc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:12.570869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88695b-46db-467d-9175-b5dde822fc13 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.570869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88695b-46db-467d-9175-b5dde822fc13 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.570869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88695b-46db-467d-9175-b5dde822fc13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.582693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88695b-46db-467d-9175-b5dde822fc13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:12.584144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88695b-46db-467d-9175-b5dde822fc13 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:12.603106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b7438-cf1a-478a-b0ac-56e8a1c2fe55 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-1f88695b-46db-467d-9175-b5dde822fc13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:12.604844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:12.606018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:12.606956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:12.606956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:12.606956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:12.606956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:12.606956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 401/795] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:12.607538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f42-f0dd-40c5-87ce-cbd187f8ced5 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.607825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f42-f0dd-40c5-87ce-cbd187f8ced5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.608105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f42-f0dd-40c5-87ce-cbd187f8ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.625214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ff371f42-f0dd-40c5-87ce-cbd187f8ced5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:12.626527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ff371f42-f0dd-40c5-87ce-cbd187f8ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:12.649175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440edccf-b828-45ee-967b-c1d80bcb5463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:12.654830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440edccf-b828-45ee-967b-c1d80bcb5463 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.654830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440edccf-b828-45ee-967b-c1d80bcb5463 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.654830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440edccf-b828-45ee-967b-c1d80bcb5463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.663804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440edccf-b828-45ee-967b-c1d80bcb5463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:12.666579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440edccf-b828-45ee-967b-c1d80bcb5463 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-440edccf-b828-45ee-967b-c1d80bcb5463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:12.685454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:12.686708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:12.687598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:12.687598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:12.687598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:12.687598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:12.687598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 395/796] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:12.688303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e32aa-e63a-472b-b330-9d57cee9c2d5 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.688586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e32aa-e63a-472b-b330-9d57cee9c2d5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.688817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e32aa-e63a-472b-b330-9d57cee9c2d5 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.694063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 396/797] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:12.694063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e32aa-e63a-472b-b330-9d57cee9c2d5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:12.709290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 402/798] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:12.709290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371f42-f0dd-40c5-87ce-cbd187f8ced5 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:12.810879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e32aa-e63a-472b-b330-9d57cee9c2d5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:12.812714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371f42-f0dd-40c5-87ce-cbd187f8ced5 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:12.848127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7b650-3174-4baf-aad2-07059d47b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:12.848788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7b650-3174-4baf-aad2-07059d47b50f None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.849064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7b650-3174-4baf-aad2-07059d47b50f None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.849338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:12.849473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7b650-3174-4baf-aad2-07059d47b50f None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.850082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7b650-3174-4baf-aad2-07059d47b50f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:12.850383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7b650-3174-4baf-aad2-07059d47b50f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:12.850755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.851208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.851652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.851753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7b650-3174-4baf-aad2-07059d47b50f None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:12.852636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:12.853341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:12.855677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:12.864538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 403/799] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:12.865927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba053-7f89-4f00-b8a7-984dbd19a4c3 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:12.866296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba053-7f89-4f00-b8a7-984dbd19a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:12.866651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba053-7f89-4f00-b8a7-984dbd19a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:12.876691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 397/800] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:12.876691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:12.888977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-2b0ba053-7f89-4f00-b8a7-984dbd19a4c3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:12.890218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2b0ba053-7f89-4f00-b8a7-984dbd19a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:12.961295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 404/801] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:12.961295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba053-7f89-4f00-b8a7-984dbd19a4c3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:12.985203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117970f-e63a-4b5f-b2c1-29c2169affb0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.020160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbfc9a-4e8b-4e1e-9805-82f868546c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.020953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbfc9a-4e8b-4e1e-9805-82f868546c2d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.021366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbfc9a-4e8b-4e1e-9805-82f868546c2d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.021645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbfc9a-4e8b-4e1e-9805-82f868546c2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.031998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbfc9a-4e8b-4e1e-9805-82f868546c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-47dbfc9a-4e8b-4e1e-9805-82f868546c2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:13.040816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:13.042096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 398/802] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:13.043401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbfc9a-4e8b-4e1e-9805-82f868546c2d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.077604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba053-7f89-4f00-b8a7-984dbd19a4c3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.115420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.116242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.116522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.117275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.123631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.125072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:13.139174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:13.140307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 405/803] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:13.141229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.153856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbfc9a-4e8b-4e1e-9805-82f868546c2d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.190635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.191492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.191794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.192294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.200064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.201538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:13.217796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:13.218799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 399/804] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:13.219758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.249557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a951-c75e-4e94-a838-6b1185a2fa4a None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.282915 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.283787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.284820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.285095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.285792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.287161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:13.299718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:13.300839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:42:13.301833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:13.305412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 406/805] 10.222.0.69 () {56 vars in 1129 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:13.306846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.340050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e566f2-07a9-4bba-aa2e-f4519be11534 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.385060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.385780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.386069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.386353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.387115 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:13.387427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.388805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.397808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 400/806] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:13.398641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.421211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56f8a-95c7-4db2-9142-5ba90cfac2a1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.481744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.483297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.484032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.484758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.486459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:13.487376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.490272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.511355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 407/807] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:13.513293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.543544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fb3cb-358b-4f48-99cc-22d9b57c75d5 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.578940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.579767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.580058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.580366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.581214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:13.581552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.583036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.606977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 401/808] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:13.606977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.625475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7c6f3-bdf8-425b-88cd-d35619394500 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.666550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.667284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.667570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.667847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.668572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:13.668881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.670302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.680309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 408/809] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:13.680309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.709125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f994dfa-7e59-4f47-8fa3-8a9014371d3e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.744727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.745567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.745844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.746121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.757008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.758494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:13.776878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:13.777914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:13.778789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:13.778789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:13.778789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:13.778789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:13.779020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02645f0c-1b12-4d65-9538-7dbd1ed96d05 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.781395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 402/810] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:13.782415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.812533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.813189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.813502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.813782 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.814650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=f6da21ec482e47399411baa3c33f4f21) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:13.815219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.816678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.833117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 409/811] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/role_assignments?user.id=f6da21ec482e47399411baa3c33f4f21&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=f1d6bdc882c24a2a9389961135865317 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:13.833117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.898764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ac174-5a0c-41c9-8fb5-082d008a1b67 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.938887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8ba48-eddf-44ff-8ae2-7d78a7f0595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.939474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941b35f-df9b-4a04-80f7-cf1f29b72fb3 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.939708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ba48-eddf-44ff-8ae2-7d78a7f0595f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.939991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ba48-eddf-44ff-8ae2-7d78a7f0595f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.940838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ba48-eddf-44ff-8ae2-7d78a7f0595f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.951736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8ba48-eddf-44ff-8ae2-7d78a7f0595f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.953373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8ba48-eddf-44ff-8ae2-7d78a7f0595f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-4af8ba48-eddf-44ff-8ae2-7d78a7f0595f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:13.975302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:13.976315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:13.978204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:13.978204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:13.978204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:13.978204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:13.978204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 403/812] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:13.979401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564af5b-30dd-4f7a-a9b0-d9b345be660a None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.979882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564af5b-30dd-4f7a-a9b0-d9b345be660a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.980252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564af5b-30dd-4f7a-a9b0-d9b345be660a None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.983692 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 404/813] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:13.983692 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564af5b-30dd-4f7a-a9b0-d9b345be660a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.989936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.990624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.990905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.991177 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.991900 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:13.992201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.993616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.998968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 410/814] 10.222.0.69 () {56 vars in 1124 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:13.999822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.104141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564af5b-30dd-4f7a-a9b0-d9b345be660a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.107323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a87d-0a7e-4297-a3c0-a850e838b29e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.139069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ab393-d96c-4eba-a540-03c0d04cdbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.139734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab393-d96c-4eba-a540-03c0d04cdbe1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.140017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab393-d96c-4eba-a540-03c0d04cdbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.140352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab393-d96c-4eba-a540-03c0d04cdbe1 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.141082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab393-d96c-4eba-a540-03c0d04cdbe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:14.141179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.141434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab393-d96c-4eba-a540-03c0d04cdbe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.141880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.142187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.142464 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.142803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab393-d96c-4eba-a540-03c0d04cdbe1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.143720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:14.144034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.145590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.155022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 405/815] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:14.156555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d891eb-8e36-464d-9e8a-afe9fdb5ad8a None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.157010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d891eb-8e36-464d-9e8a-afe9fdb5ad8a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.161731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 411/816] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:14.161731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.161961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d891eb-8e36-464d-9e8a-afe9fdb5ad8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.178428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-47d891eb-8e36-464d-9e8a-afe9fdb5ad8a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:14.179662 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-47d891eb-8e36-464d-9e8a-afe9fdb5ad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:14.247195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 406/817] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:14.248063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d891eb-8e36-464d-9e8a-afe9fdb5ad8a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.269543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f46cd-eec3-4f3f-b704-d74df3d209c7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.309517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864122d-3565-4daf-a71a-28026465e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.310186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864122d-3565-4daf-a71a-28026465e2b1 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.310465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864122d-3565-4daf-a71a-28026465e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.310737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864122d-3565-4daf-a71a-28026465e2b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.311473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864122d-3565-4daf-a71a-28026465e2b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.312825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864122d-3565-4daf-a71a-28026465e2b1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.358052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d891eb-8e36-464d-9e8a-afe9fdb5ad8a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.392048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.392851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.393168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.393542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.400592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.402051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:14.417308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:14.418276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 407/818] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:42:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:14.419227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.435848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 412/819] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:42:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:14.436792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864122d-3565-4daf-a71a-28026465e2b1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.553589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e4df-cbec-4fe7-96c6-eada17513f86 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.559155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864122d-3565-4daf-a71a-28026465e2b1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.593706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.595124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.595712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.596823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.597876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.598694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.598977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.599254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] PATH_INFO: `/v3/services/network` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.599924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.601351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.607281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.609252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:14.614966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:14.617279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:14.618156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 413/820] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:14 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:14.618993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:14.630125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:14.631098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:14.632039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:14.632039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:14.632039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:14.632039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:14.632039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:14.632039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:14.632039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:14.632039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:14.634719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 408/821] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:14.635856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.741490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed07b53-980a-4b88-a7b4-60652dd3967e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.761947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caa1c8-480f-4d9e-9db0-81d13faeb77e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.778307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.778984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.779267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.779783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.780377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:14.782905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.784411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.805655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 414/822] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 13:42:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:14.806569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.810468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.811598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.812097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.812577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.814000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] RBAC: Adding query filter params (name=network) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:14.816027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.817762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.824961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 409/823] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:14.826094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.918072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75795cba-bae9-471a-b479-8472d0a828ce None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.953497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf399e-d2f7-43b5-9411-29817e9dc567 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:14.953696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.954314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.954596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.954872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:14.955842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:14.956158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:14.958350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:14.974590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 415/824] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:14.975510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:14.991831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:14.993001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:14.993563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:14.994173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:15.006014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:15.007931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:15.026331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:15.027285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:15.028191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:15.028191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:15.028191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:15.028191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:15.030496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 410/825] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:15.031538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:15.084265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fd6c9-87aa-444d-8816-d28e1961fae8 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:15.119531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:15.120215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:15.120731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:15.120731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:15.121492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] RBAC: Adding query filter params (type=network) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:15.121798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:15.123167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:15.129092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 416/826] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:15.130107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:15.141166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158cc1c-2c53-46e2-a557-c9debcdc58ae None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:15.177011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe77e-b0b5-4370-ab26-d45a8f980e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:15.178318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe77e-b0b5-4370-ab26-d45a8f980e47 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:15.178812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe77e-b0b5-4370-ab26-d45a8f980e47 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:15.179319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe77e-b0b5-4370-ab26-d45a8f980e47 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/52aa32e8c0f742659725ddec932014b8/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:15.181632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfe77e-b0b5-4370-ab26-d45a8f980e47 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=52aa32e8c0f742659725ddec932014b8, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:15.183318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfe77e-b0b5-4370-ab26-d45a8f980e47 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:15.232489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7923e8-ecb5-4d25-909a-2d885523a0cd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:15.285355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 411/827] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:42:15 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/52aa32e8c0f742659725ddec932014b8/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:42:15.285355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe77e-b0b5-4370-ab26-d45a8f980e47 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:15.285651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:15.285651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:15.285651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:15.285651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:15.285924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:15.285924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:15.285924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:15.292085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 417/828] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:15.298058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:15.411544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6ff97-365d-4a21-a0a7-6fa3d81e76f4 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:15.451419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:15.452229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:15.452511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:15.452794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:15.461425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:15.462976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:15.478679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:15.479630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:15.480764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 418/829] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:15.486412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:15.502193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe77e-b0b5-4370-ab26-d45a8f980e47 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:15.555159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5bb1c-2ffa-4bd6-bca0-6565cc41e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:15.555756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5bb1c-2ffa-4bd6-bca0-6565cc41e676 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:15.556039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5bb1c-2ffa-4bd6-bca0-6565cc41e676 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:15.556312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5bb1c-2ffa-4bd6-bca0-6565cc41e676 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:15.557063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5bb1c-2ffa-4bd6-bca0-6565cc41e676 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:15.558480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5bb1c-2ffa-4bd6-bca0-6565cc41e676 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:15.601592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cbf3f-2d85-4a0b-8692-e636166ad90d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:15.637933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a25d90-6536-4959-aef1-62dd03332308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:15.638622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a25d90-6536-4959-aef1-62dd03332308 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:15.638908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a25d90-6536-4959-aef1-62dd03332308 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:15.639187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a25d90-6536-4959-aef1-62dd03332308 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:15.640118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a25d90-6536-4959-aef1-62dd03332308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:15.640663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a25d90-6536-4959-aef1-62dd03332308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:15.642155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a25d90-6536-4959-aef1-62dd03332308 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:15.652393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 412/830] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:42:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:15.657097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 419/831] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:15.665646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5bb1c-2ffa-4bd6-bca0-6565cc41e676 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:15.794774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5bb1c-2ffa-4bd6-bca0-6565cc41e676 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:15.842381 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c3434-620e-4621-843f-5261fbe66ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:15.843304 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3434-620e-4621-843f-5261fbe66ee1 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:15.843584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3434-620e-4621-843f-5261fbe66ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:15.843865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c3434-620e-4621-843f-5261fbe66ee1 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/d58026a187ef48d69fa18853db63cd43/roles/0827027c0db142779b191de9ce1ece80` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:15.862745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c3434-620e-4621-843f-5261fbe66ee1 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=d58026a187ef48d69fa18853db63cd43, role_id=0827027c0db142779b191de9ce1ece80)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:15.865526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c3434-620e-4621-843f-5261fbe66ee1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:15.945521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 413/832] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:42:15 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/d58026a187ef48d69fa18853db63cd43/roles/0827027c0db142779b191de9ce1ece80 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:42:16.420986 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7dca-c5d9-4006-8490-d64d4a99be78 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:16.421745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7dca-c5d9-4006-8490-d64d4a99be78 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:16.421745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec7dca-c5d9-4006-8490-d64d4a99be78 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:16.423243 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 420/833] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:16.431279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bebba5-37f4-4cc6-9947-d99cd742d014 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:16.431652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bebba5-37f4-4cc6-9947-d99cd742d014 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:16.431935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bebba5-37f4-4cc6-9947-d99cd742d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:16.450880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-56bebba5-37f4-4cc6-9947-d99cd742d014 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:16.452091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-56bebba5-37f4-4cc6-9947-d99cd742d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:16.530428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 414/834] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:16.560229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec7dca-c5d9-4006-8490-d64d4a99be78 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:16.684423 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec7dca-c5d9-4006-8490-d64d4a99be78 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:16.722311 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:16.723131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:16.723459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:16.723738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:16.724411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:16.725852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:16.739578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:16.742520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:16.744474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:16.746366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 421/835] 10.222.0.69 () {56 vars in 1132 bytes} [Wed May 4 13:42:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:16.757977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bebba5-37f4-4cc6-9947-d99cd742d014 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:16.875375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bebba5-37f4-4cc6-9947-d99cd742d014 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:16.916463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef443f-640f-4831-925b-a9b5e330e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:16.917610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef443f-640f-4831-925b-a9b5e330e741 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:16.918140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef443f-640f-4831-925b-a9b5e330e741 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:16.918621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef443f-640f-4831-925b-a9b5e330e741 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:16.920125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef443f-640f-4831-925b-a9b5e330e741 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:16.920863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef443f-640f-4831-925b-a9b5e330e741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:16.922653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef443f-640f-4831-925b-a9b5e330e741 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:16.929210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 415/836] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:16.935806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:17.066927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d34863-4f0d-4c2d-865f-ba65dc2e749e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:17.121428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:17.123040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:17.123895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:17.124691 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:17.126435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:17.127325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:17.130313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:17.132805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c83d-aab1-4a3b-8979-d0ee489ec93f None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:17.133393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c83d-aab1-4a3b-8979-d0ee489ec93f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:17.133889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c83d-aab1-4a3b-8979-d0ee489ec93f None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:17.135780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 416/837] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:17.136228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 422/838] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:17.144008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd6cb-b2d6-42a8-8952-b78ea209482c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:17.144805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd6cb-b2d6-42a8-8952-b78ea209482c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:17.145338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fd6cb-b2d6-42a8-8952-b78ea209482c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:17.165515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-859fd6cb-b2d6-42a8-8952-b78ea209482c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:17.167159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-859fd6cb-b2d6-42a8-8952-b78ea209482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:17.259124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 417/839] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:17.281161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:17.391052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0e055-02a9-4bcb-9a31-568b8f746a2d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:17.432599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:17.433523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:17.433867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:17.434025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:17.434636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:17.436022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:17.449512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:17.451514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:17.453295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 423/840] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:17.458982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fd6cb-b2d6-42a8-8952-b78ea209482c None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:17.560071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fd6cb-b2d6-42a8-8952-b78ea209482c None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:17.596070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888cb3e-25f6-41e8-8759-26b8d0210b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:17.597654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888cb3e-25f6-41e8-8759-26b8d0210b17 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:17.598151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888cb3e-25f6-41e8-8759-26b8d0210b17 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:17.598616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888cb3e-25f6-41e8-8759-26b8d0210b17 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:17.599537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888cb3e-25f6-41e8-8759-26b8d0210b17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:17.600034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888cb3e-25f6-41e8-8759-26b8d0210b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:17.601637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888cb3e-25f6-41e8-8759-26b8d0210b17 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:17.607214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 418/841] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:17.613971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:17.728331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344301e7-9779-4f53-8fca-df6f19615feb None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:17.768289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca73d72-8659-4a8f-a272-8f0c1ecaacf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:17.768956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73d72-8659-4a8f-a272-8f0c1ecaacf5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:17.769254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73d72-8659-4a8f-a272-8f0c1ecaacf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:17.769548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73d72-8659-4a8f-a272-8f0c1ecaacf5 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:17.770269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca73d72-8659-4a8f-a272-8f0c1ecaacf5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:17.770578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca73d72-8659-4a8f-a272-8f0c1ecaacf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:17.771951 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca73d72-8659-4a8f-a272-8f0c1ecaacf5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:17.777267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 424/842] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:17.920442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731da83-57ed-466f-8121-6b7a41b19e6f None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:17.920997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731da83-57ed-466f-8121-6b7a41b19e6f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:17.920997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731da83-57ed-466f-8121-6b7a41b19e6f None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:17.922744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 419/843] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:17.928965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950e043-45ab-464b-8060-9e1a356e8312 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:17.929346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950e043-45ab-464b-8060-9e1a356e8312 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:17.929551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950e043-45ab-464b-8060-9e1a356e8312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:17.947735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c950e043-45ab-464b-8060-9e1a356e8312 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:17.948944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c950e043-45ab-464b-8060-9e1a356e8312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:18.022505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 425/844] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:18.045851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731da83-57ed-466f-8121-6b7a41b19e6f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:18.168905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731da83-57ed-466f-8121-6b7a41b19e6f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:18.205474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8989-410b-49fa-9f69-8eab9c2002e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:18.206529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8989-410b-49fa-9f69-8eab9c2002e1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:18.206810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8989-410b-49fa-9f69-8eab9c2002e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:18.207082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8989-410b-49fa-9f69-8eab9c2002e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:18.218219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8989-410b-49fa-9f69-8eab9c2002e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-856b8989-410b-49fa-9f69-8eab9c2002e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:18.226542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:18.227464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:18.228773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 420/845] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:18.238403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950e043-45ab-464b-8060-9e1a356e8312 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:18.345985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950e043-45ab-464b-8060-9e1a356e8312 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:18.387142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd988d7-7802-4edd-a236-03c470f382d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:18.389072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd988d7-7802-4edd-a236-03c470f382d7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:18.389608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd988d7-7802-4edd-a236-03c470f382d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:18.390111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd988d7-7802-4edd-a236-03c470f382d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:18.391138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd988d7-7802-4edd-a236-03c470f382d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:18.391674 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd988d7-7802-4edd-a236-03c470f382d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:18.393638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd988d7-7802-4edd-a236-03c470f382d7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:18.408380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 426/846] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:18.411394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8989-410b-49fa-9f69-8eab9c2002e1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:18.531254 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8989-410b-49fa-9f69-8eab9c2002e1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:18.565671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:18.566595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:18.566876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:18.567148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:18.578131 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:18.579587 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:18.589011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc03d5-7ad7-4cc6-a4a6-bad016ece6b1 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:18.589539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc03d5-7ad7-4cc6-a4a6-bad016ece6b1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:18.589624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc03d5-7ad7-4cc6-a4a6-bad016ece6b1 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:18.591211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 427/847] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:18.596300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6527f9-97f0-48ca-93e3-94b389530466 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:18.596729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6527f9-97f0-48ca-93e3-94b389530466 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:18.597215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6527f9-97f0-48ca-93e3-94b389530466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:18.597985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:18.598876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:18.600217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:18.600217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:18.600217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:18.600217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:18.600217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 421/848] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:18.607727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:18.618304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ce6527f9-97f0-48ca-93e3-94b389530466 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:18.619551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ce6527f9-97f0-48ca-93e3-94b389530466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:18.702492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 428/849] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:18.730918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6527f9-97f0-48ca-93e3-94b389530466 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:18.736499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdf4af-355d-4762-8542-15c20c32a0e0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:18.779452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:18.780129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:18.781326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:18.781571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:18.782376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:18.782687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:18.784776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:18.801158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 422/850] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:18.807201 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:18.862459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6527f9-97f0-48ca-93e3-94b389530466 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:18.908063 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09303e44-4494-4280-a731-a9ec816d0b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:18.910549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09303e44-4494-4280-a731-a9ec816d0b49 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:18.911134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09303e44-4494-4280-a731-a9ec816d0b49 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:18.911664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09303e44-4494-4280-a731-a9ec816d0b49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:18.913312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34feda-ab7a-48fe-ad3e-1da73b20e0e2 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:18.926649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09303e44-4494-4280-a731-a9ec816d0b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-09303e44-4494-4280-a731-a9ec816d0b49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:18.934575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:18.935538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:42:18.936365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:18.940685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 429/851] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:18.942640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09303e44-4494-4280-a731-a9ec816d0b49 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:18.966142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:18.968120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:18.968921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:18.969438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:18.980513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:18.982846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:19.005196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:19.006301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:42:19.007225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:19.009969 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 423/852] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:19.015931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.066659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09303e44-4494-4280-a731-a9ec816d0b49 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:19.109378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:19.110448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.110958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.111438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.112741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:19.113281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:19.115027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.128901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44de4c-0c43-44a2-bc92-cf37f4b8b53a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:19.129280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 430/853] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:19.130412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.168525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:19.168973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.169278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.169554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.170399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:19.170704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:19.172138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.195780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 424/854] 10.222.0.69 () {56 vars in 1135 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:19.196966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.253367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef63a-e852-4197-abc4-833806de6e77 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:19.295541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:19.296364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.296798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.297079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.311611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:19.313081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.323608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57ea4-ecac-42dc-afa0-9b16ec11dbb9 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:19.331304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:19.332483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:19.333400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:19.333400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:19.333400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:19.333400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:19.333400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 431/855] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:19.339244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.366621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35e48-e779-4021-8dc6-c94274329b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:19.367283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35e48-e779-4021-8dc6-c94274329b3d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.367574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35e48-e779-4021-8dc6-c94274329b3d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.367853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35e48-e779-4021-8dc6-c94274329b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.460180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf35e48-e779-4021-8dc6-c94274329b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:19.461829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf35e48-e779-4021-8dc6-c94274329b3d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.469634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84965a56-8442-4798-940b-e84781e75a98 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:19.507109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:19.508166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.508651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.509125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.510111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:19.510639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:19.512211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.529862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 432/856] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:19.531133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.574309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 425/857] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:19.578963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35e48-e779-4021-8dc6-c94274329b3d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.651230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542db3-cfd3-41f1-99ec-b6e1543730e4 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:19.689073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39723bd-9d3e-4c81-9ba0-05669c1969fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:19.690107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39723bd-9d3e-4c81-9ba0-05669c1969fa None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.690298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39723bd-9d3e-4c81-9ba0-05669c1969fa None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.690579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39723bd-9d3e-4c81-9ba0-05669c1969fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.697827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39723bd-9d3e-4c81-9ba0-05669c1969fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:19.699268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39723bd-9d3e-4c81-9ba0-05669c1969fa None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.700166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35e48-e779-4021-8dc6-c94274329b3d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-a39723bd-9d3e-4c81-9ba0-05669c1969fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:19.714221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:19.715203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:19.716169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 433/858] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:19.716749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dce72a-05f5-4d30-a921-d7d3df25624c None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.717377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dce72a-05f5-4d30-a921-d7d3df25624c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.717377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dce72a-05f5-4d30-a921-d7d3df25624c None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.718776 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 434/859] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:19.720931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dce72a-05f5-4d30-a921-d7d3df25624c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.744155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c542f-baf8-4af9-8e6a-b11fb9c5fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:19.744965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c542f-baf8-4af9-8e6a-b11fb9c5fea0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.745270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c542f-baf8-4af9-8e6a-b11fb9c5fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.745560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c542f-baf8-4af9-8e6a-b11fb9c5fea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.759292 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c542f-baf8-4af9-8e6a-b11fb9c5fea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:19.760700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c542f-baf8-4af9-8e6a-b11fb9c5fea0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-7c3c542f-baf8-4af9-8e6a-b11fb9c5fea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:19.782954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:19.784571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:19.785492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:19.785492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:19.785492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:19.785492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:19.785492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 426/860] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:19.786697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74286-3413-4f10-b955-381f2dd99936 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.786697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74286-3413-4f10-b955-381f2dd99936 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.786885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74286-3413-4f10-b955-381f2dd99936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.804849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-f8b74286-3413-4f10-b955-381f2dd99936 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:19.806075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f8b74286-3413-4f10-b955-381f2dd99936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:19.839467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dce72a-05f5-4d30-a921-d7d3df25624c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:19.874336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:19.875001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:19.875283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:19.875559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:19.885422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 427/861] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:19.885594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:19.885594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:19.885869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74286-3413-4f10-b955-381f2dd99936 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.885955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:19.895934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 435/862] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:19.902364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:19.999748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74286-3413-4f10-b955-381f2dd99936 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.005161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c0b23-e5ff-44f1-81c7-2fa99adaa5ce None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.035587 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.036513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.037012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.037471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.038359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:20.038793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.039600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c083c-cc59-4080-a0dd-8d8998dfcef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.040249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c083c-cc59-4080-a0dd-8d8998dfcef3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.040536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c083c-cc59-4080-a0dd-8d8998dfcef3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.040769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.040878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c083c-cc59-4080-a0dd-8d8998dfcef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.054627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 428/863] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:20.055445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:20.116586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c083c-cc59-4080-a0dd-8d8998dfcef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.117989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c083c-cc59-4080-a0dd-8d8998dfcef3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.153537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db92e-e349-4737-b65c-0e6e9b47ceb6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.186455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4a5ff-6873-41f6-91eb-0e7046497626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.187162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a5ff-6873-41f6-91eb-0e7046497626 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.187440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a5ff-6873-41f6-91eb-0e7046497626 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.187714 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4a5ff-6873-41f6-91eb-0e7046497626 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.188430 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4a5ff-6873-41f6-91eb-0e7046497626 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.190099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4a5ff-6873-41f6-91eb-0e7046497626 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.214437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 436/864] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:20.215365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c083c-cc59-4080-a0dd-8d8998dfcef3 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:20.264840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 429/865] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:42:20 2022] POST /identity/v3/services => generated 269 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:20.266312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09c54-8f28-428b-96ab-f7ba81bd5427 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.266611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09c54-8f28-428b-96ab-f7ba81bd5427 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.266896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09c54-8f28-428b-96ab-f7ba81bd5427 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.268981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 430/866] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:20.269634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c09c54-8f28-428b-96ab-f7ba81bd5427 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:20.326496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c083c-cc59-4080-a0dd-8d8998dfcef3 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.372521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caeffdf-b6df-4cf9-86b1-3f168dfcaa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.374189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeffdf-b6df-4cf9-86b1-3f168dfcaa83 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.374814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeffdf-b6df-4cf9-86b1-3f168dfcaa83 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.375407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeffdf-b6df-4cf9-86b1-3f168dfcaa83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.384308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c09c54-8f28-428b-96ab-f7ba81bd5427 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.387656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caeffdf-b6df-4cf9-86b1-3f168dfcaa83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.390768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caeffdf-b6df-4cf9-86b1-3f168dfcaa83 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-2caeffdf-b6df-4cf9-86b1-3f168dfcaa83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:20.407858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:20.409027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:20.410206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:20.410206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:20.410206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:20.410206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:20.410206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:20.410206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:20.410206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:20.410206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:20.413568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 437/867] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:20.414950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17eb69-926c-4adf-9136-66f111a6c3bc None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.415332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17eb69-926c-4adf-9136-66f111a6c3bc None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.415615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17eb69-926c-4adf-9136-66f111a6c3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.426979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.428179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.428616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.429041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.433338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ff17eb69-926c-4adf-9136-66f111a6c3bc None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:20.434559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ff17eb69-926c-4adf-9136-66f111a6c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:20.442664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.444139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:20.462782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:20.463918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:20.465024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:20.465024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:20.465024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:20.465024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:20.465024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 431/868] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:20.465024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:20.516574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 438/869] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:20 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:20.517457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17eb69-926c-4adf-9136-66f111a6c3bc None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:20.585467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d9cf-38ab-425b-af72-bb16da0b7b82 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.620020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17eb69-926c-4adf-9136-66f111a6c3bc None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.622418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.623139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.623366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.623644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.624439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:20.624902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.626221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.639236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 432/870] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:20.640673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:20.659205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.659777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.660060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.660347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.661038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:20.661392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.662795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.682478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 439/871] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:20.683692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:20.751283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145dd22-00eb-4337-9476-c55071f71e50 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.789835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcda58-a48d-44d8-93b8-cc15445801e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.790513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcda58-a48d-44d8-93b8-cc15445801e4 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.790793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcda58-a48d-44d8-93b8-cc15445801e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.791065 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcda58-a48d-44d8-93b8-cc15445801e4 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.791791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcda58-a48d-44d8-93b8-cc15445801e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.793168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcda58-a48d-44d8-93b8-cc15445801e4 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.816228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7445b82-9048-4857-ac34-280cc3db6f7d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:20.850699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:20.851351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:20.851631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:20.851906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:20.852734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=52aa32e8c0f742659725ddec932014b8) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:20.853043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:20.854503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:20.860556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 440/872] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:20 2022] GET /identity/v3/role_assignments?user.id=52aa32e8c0f742659725ddec932014b8&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=f1d6bdc882c24a2a9389961135865317 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:20.861359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:20.914665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 433/873] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:42:20 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:20.982449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b58956-1985-447e-b984-4ef508d7f389 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:21.032489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:21.033813 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:21.035005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:21.035468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:21.044073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:21.045985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:21.064071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:21.065116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:21.066777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:21.066777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:21.066777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:21.066777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:21.066777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:21.066777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:21.066777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:21.066777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:21.069277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 441/874] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:21.075594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcda58-a48d-44d8-93b8-cc15445801e4 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:21.197569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcda58-a48d-44d8-93b8-cc15445801e4 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:21.233269 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda45a2-5c44-46f4-ae68-14fd5aa0a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:21.233998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda45a2-5c44-46f4-ae68-14fd5aa0a502 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:21.234283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda45a2-5c44-46f4-ae68-14fd5aa0a502 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:21.234564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda45a2-5c44-46f4-ae68-14fd5aa0a502 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:21.235366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda45a2-5c44-46f4-ae68-14fd5aa0a502 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:21.235677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda45a2-5c44-46f4-ae68-14fd5aa0a502 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:21.237421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda45a2-5c44-46f4-ae68-14fd5aa0a502 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:21.249753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 434/875] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:21.256009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:21.361187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57c28-460c-4ae1-869f-00ad85b8eddd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:21.397351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7291354-91fa-440e-84f2-85db906bddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:21.398282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291354-91fa-440e-84f2-85db906bddc8 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:21.398708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291354-91fa-440e-84f2-85db906bddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:21.399123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291354-91fa-440e-84f2-85db906bddc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:21.400094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7291354-91fa-440e-84f2-85db906bddc8 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=d58026a187ef48d69fa18853db63cd43) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:21.400555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7291354-91fa-440e-84f2-85db906bddc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:21.402151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7291354-91fa-440e-84f2-85db906bddc8 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:21.413614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 442/876] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:21 2022] GET /identity/v3/role_assignments?user.id=d58026a187ef48d69fa18853db63cd43&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:22.600028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653228-2bdd-48bd-987e-338c4ff0cf6f None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:22.600550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653228-2bdd-48bd-987e-338c4ff0cf6f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:22.600657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653228-2bdd-48bd-987e-338c4ff0cf6f None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:22.602231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 435/877] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:22.607843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46ec0-779b-4096-8b40-17e2035c15e1 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:22.608261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46ec0-779b-4096-8b40-17e2035c15e1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:22.608402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f46ec0-779b-4096-8b40-17e2035c15e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:22.626640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d8f46ec0-779b-4096-8b40-17e2035c15e1 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:22.627897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d8f46ec0-779b-4096-8b40-17e2035c15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:22.700187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 443/878] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:22.723579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653228-2bdd-48bd-987e-338c4ff0cf6f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:22.833220 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653228-2bdd-48bd-987e-338c4ff0cf6f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:22.871842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:22.872580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:22.872863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:22.873142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:22.873837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:22.875207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:22.887715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:22.888687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:22.889620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 436/879] 10.222.0.69 () {56 vars in 1132 bytes} [Wed May 4 13:42:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:22.895261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f46ec0-779b-4096-8b40-17e2035c15e1 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.002481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f46ec0-779b-4096-8b40-17e2035c15e1 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:23.037313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:23.037989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.038270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.038545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.039258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:23.039557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:23.040928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:23.047334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 444/880] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:23.053514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.170948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fd766-5a74-44b7-8228-2e1e0af22bad None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:23.211806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9f53a-52bc-41a4-b153-07639e2b6aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:23.212552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f53a-52bc-41a4-b153-07639e2b6aed None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.212830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f53a-52bc-41a4-b153-07639e2b6aed None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.213149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f53a-52bc-41a4-b153-07639e2b6aed None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.213918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9f53a-52bc-41a4-b153-07639e2b6aed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:23.214219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9f53a-52bc-41a4-b153-07639e2b6aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:23.215604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9f53a-52bc-41a4-b153-07639e2b6aed None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:23.221572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 437/881] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:23.227351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.321346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f383d3-4e8b-4e6e-b8e1-0de4212cee75 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.321346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f383d3-4e8b-4e6e-b8e1-0de4212cee75 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.321346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f383d3-4e8b-4e6e-b8e1-0de4212cee75 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.322247 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 438/882] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:23.327669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9a4c5-0388-4ff5-962a-79eed12cb58c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.328232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9a4c5-0388-4ff5-962a-79eed12cb58c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.328720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9a4c5-0388-4ff5-962a-79eed12cb58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.332518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5458d0c-d086-4626-9cc6-90a95dedf046 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:23.347402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-58e9a4c5-0388-4ff5-962a-79eed12cb58c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:23.348945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-58e9a4c5-0388-4ff5-962a-79eed12cb58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:23.370631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60259931-704f-4e51-9ec2-24041e946fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:23.371296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259931-704f-4e51-9ec2-24041e946fb2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.371574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259931-704f-4e51-9ec2-24041e946fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.371845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259931-704f-4e51-9ec2-24041e946fb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.373024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60259931-704f-4e51-9ec2-24041e946fb2 None admin] RBAC: Adding query filter params (interface=public, service_id=c650bcc917154df88beeef3889e637ce, region_id=RegionOne) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:23.373024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60259931-704f-4e51-9ec2-24041e946fb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:23.374322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60259931-704f-4e51-9ec2-24041e946fb2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:23.380575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 445/883] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 13:42:23 2022] GET /identity/v3/endpoints?service_id=c650bcc917154df88beeef3889e637ce&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:23.386312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7143-01b0-494e-9b60-0ac894ce7449 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.386701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7143-01b0-494e-9b60-0ac894ce7449 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.386985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7143-01b0-494e-9b60-0ac894ce7449 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.388437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 446/884] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:23.389021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7143-01b0-494e-9b60-0ac894ce7449 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.437342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 439/885] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:23.437342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a50a09-c48c-4972-8076-cdd11c761655 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.437342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a50a09-c48c-4972-8076-cdd11c761655 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.437342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a50a09-c48c-4972-8076-cdd11c761655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.447753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d9a50a09-c48c-4972-8076-cdd11c761655 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:23.448984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d9a50a09-c48c-4972-8076-cdd11c761655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:23.509146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7143-01b0-494e-9b60-0ac894ce7449 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:23.519286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 440/886] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:23.521361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a50a09-c48c-4972-8076-cdd11c761655 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.554433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f9a6-c08e-4027-b645-5cf14727c727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:23.555097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f9a6-c08e-4027-b645-5cf14727c727 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.555377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f9a6-c08e-4027-b645-5cf14727c727 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.555649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f9a6-c08e-4027-b645-5cf14727c727 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.556334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f9a6-c08e-4027-b645-5cf14727c727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:23.557759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f9a6-c08e-4027-b645-5cf14727c727 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:23.563879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 447/887] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:42:23 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:42:23.564510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f9a6-c08e-4027-b645-5cf14727c727 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.640203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a50a09-c48c-4972-8076-cdd11c761655 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:23.683954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:23.685088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.685625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.686085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.686948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:23.688746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:23.696027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f9a6-c08e-4027-b645-5cf14727c727 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:23.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:23.704412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:23.705267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:23.712977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 441/888] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:23.714257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.740734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:23.741594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.741864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.742138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.742804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:23.744247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:23.757492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:23.758572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:23.759401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 448/889] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:23.770424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.828231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58410c3-0cd3-4d6f-a0f2-09d177491556 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:23.866539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246c408-215b-43ee-b55c-819a4a6061db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:23.867212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246c408-215b-43ee-b55c-819a4a6061db None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.867495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246c408-215b-43ee-b55c-819a4a6061db None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.867771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246c408-215b-43ee-b55c-819a4a6061db None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.868484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246c408-215b-43ee-b55c-819a4a6061db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:23.868853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246c408-215b-43ee-b55c-819a4a6061db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:23.870299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246c408-215b-43ee-b55c-819a4a6061db None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:23.875343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 442/890] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:23.880029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9a6f-26c3-4311-8754-f9513d434129 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.880029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9a6f-26c3-4311-8754-f9513d434129 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.880029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9a6f-26c3-4311-8754-f9513d434129 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.880294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88595f-8fd1-49e0-8133-b1fd8f7c738b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:23.880396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 443/891] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:23.880999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a9a6f-26c3-4311-8754-f9513d434129 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:23.917096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147dad7-f949-4b6b-99d9-c1d792151547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:23.917868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147dad7-f949-4b6b-99d9-c1d792151547 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.918150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147dad7-f949-4b6b-99d9-c1d792151547 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.918427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147dad7-f949-4b6b-99d9-c1d792151547 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.919136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147dad7-f949-4b6b-99d9-c1d792151547 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:23.919439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147dad7-f949-4b6b-99d9-c1d792151547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:23.920796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147dad7-f949-4b6b-99d9-c1d792151547 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:23.926765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 449/892] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:23.928675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03844d48-b160-4912-a41d-986adcfb1956 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:23.929175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03844d48-b160-4912-a41d-986adcfb1956 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:23.929815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03844d48-b160-4912-a41d-986adcfb1956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:23.947135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-03844d48-b160-4912-a41d-986adcfb1956 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:23.948230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-03844d48-b160-4912-a41d-986adcfb1956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:23.987948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a9a6f-26c3-4311-8754-f9513d434129 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.015501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 450/893] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:24.016704 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03844d48-b160-4912-a41d-986adcfb1956 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:24.036085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.037082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.037557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.038007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:24.039338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:24.039828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:24.042251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:24.052954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 444/894] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:24.052954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:24.122347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03844d48-b160-4912-a41d-986adcfb1956 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.153227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b5a85-298a-4cfb-a12d-4b2a53cedf4e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.156505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.157167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.157482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.157761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:24.159078 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:24.159412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:24.160794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:24.169284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 451/895] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:24.169284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:24.208239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c5ed-cb04-44ad-888a-e8c454aa65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.209466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c5ed-cb04-44ad-888a-e8c454aa65a8 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.209931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c5ed-cb04-44ad-888a-e8c454aa65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.210403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c5ed-cb04-44ad-888a-e8c454aa65a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:24.225778 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c5ed-cb04-44ad-888a-e8c454aa65a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-8a34c5ed-cb04-44ad-888a-e8c454aa65a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:24.238290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:24.239341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:24.240180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:24.247873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 445/896] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 13:42:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:24.249429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c5ed-cb04-44ad-888a-e8c454aa65a8 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:24.298312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64eeb8-8d6b-4caf-9344-d8a4411ade00 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.339130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.340307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.340796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.341327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:24.342377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] RBAC: Adding query filter params (interface=public, service_id=582eb36f0c7647e49055aabb60d7344d, region_id=RegionOne) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:24.342915 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:24.344577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:24.357188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 452/897] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 13:42:24 2022] GET /identity/v3/endpoints?service_id=582eb36f0c7647e49055aabb60d7344d&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:24.358595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:24.374625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c5ed-cb04-44ad-888a-e8c454aa65a8 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.421970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.423114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.423408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.423847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:24.425483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:24.425804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:24.427919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:24.441210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 446/898] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 13:42:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:24.450575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:24.475496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957644e2-da7f-4540-be60-d646d5fb88d1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.515937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5cb0b-40d8-4657-a1b4-ab52b130e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.516757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5cb0b-40d8-4657-a1b4-ab52b130e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.517115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5cb0b-40d8-4657-a1b4-ab52b130e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.517491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5cb0b-40d8-4657-a1b4-ab52b130e1a3 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:24.518294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5cb0b-40d8-4657-a1b4-ab52b130e1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:24.519820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5cb0b-40d8-4657-a1b4-ab52b130e1a3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:24.529779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 453/899] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:42:24 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:42:24.580838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea332bad-1adb-4f72-ba51-1e999c4be439 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.625144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.626304 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.626800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.627408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:24.640303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:24.642580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:24.663301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:24.664350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:24.665259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:24.665259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:24.665259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:24.665259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:24.667427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 447/900] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:24.675410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5cb0b-40d8-4657-a1b4-ab52b130e1a3 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:24.785424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5cb0b-40d8-4657-a1b4-ab52b130e1a3 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.824599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.825720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.826203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.826675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:24.827636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:24.828244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:24.829925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:24.843289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 454/901] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:24.853286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:24.955803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77fb09-7c7c-4169-98f4-cfc6ccaaf4a1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:24.992839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:24.993683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:24.993965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:24.994236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:25.002182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:25.003891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:25.018756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:25.019695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:25.021091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 448/902] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:42:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:25.025656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:25.131366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f29ee-28d0-4a75-b108-85ee6ff95c6c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:25.165722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:25.166387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:25.166666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:25.166937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:25.167770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:25.168076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:25.169529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:25.188134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 455/903] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 13:42:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:25.194676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:25.301150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b5c0e-66f4-4091-858b-7286e54ae1ee None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:25.335705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4579-3e1c-4c61-8ce6-de9738dda8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:25.336362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4579-3e1c-4c61-8ce6-de9738dda8d2 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:25.336644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4579-3e1c-4c61-8ce6-de9738dda8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:25.336921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4579-3e1c-4c61-8ce6-de9738dda8d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:25.410828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf4579-3e1c-4c61-8ce6-de9738dda8d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:25.412286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf4579-3e1c-4c61-8ce6-de9738dda8d2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:25.518354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 449/904] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:25 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:25.526615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:25.635566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc40d-7c17-48fb-9542-9224266d29d3 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:25.673669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:25.675247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:25.675533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:25.675799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:25.686490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:25.688106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:25.706363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:25.708637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:25.710774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:25.710774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:25.710774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:25.710774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:25.710774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 456/905] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:25.714254 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4579-3e1c-4c61-8ce6-de9738dda8d2 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:25.820213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4579-3e1c-4c61-8ce6-de9738dda8d2 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:25.854990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:25.855965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:25.856244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:25.856560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:25.857353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:25.857776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:25.859338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:25.872515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 450/906] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:25.879039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:25.981728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ea798-ac6d-42b8-b992-74a3b03875cc None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:26.017354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adb2cd-175f-40e1-878b-cee9eb4832b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:26.018671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adb2cd-175f-40e1-878b-cee9eb4832b0 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.018998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adb2cd-175f-40e1-878b-cee9eb4832b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.019278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adb2cd-175f-40e1-878b-cee9eb4832b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.026385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adb2cd-175f-40e1-878b-cee9eb4832b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:26.027911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72adb2cd-175f-40e1-878b-cee9eb4832b0 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-72adb2cd-175f-40e1-878b-cee9eb4832b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:26.042157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:26.043060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:26.044866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 457/907] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:26.050195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:26.120814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c957d9-67ae-4253-94ca-e211531e03b8 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.120814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c957d9-67ae-4253-94ca-e211531e03b8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.120814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c957d9-67ae-4253-94ca-e211531e03b8 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.121444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 458/908] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:26.126958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab1c13-1ada-43c1-b187-605999557a35 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.127728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab1c13-1ada-43c1-b187-605999557a35 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.128223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab1c13-1ada-43c1-b187-605999557a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.146442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-eeab1c13-1ada-43c1-b187-605999557a35 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:26.148013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-eeab1c13-1ada-43c1-b187-605999557a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:26.159172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe2c99-3f08-4a75-8b89-aaa194abe8a6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:26.196120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:26.196790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.197074 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.197379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.198232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:26.198547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:26.200025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:26.215239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 451/909] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:26.221861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:26.223921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 459/910] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:26.247174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab1c13-1ada-43c1-b187-605999557a35 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:26.327509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50070-ad3f-47a9-b31b-0b463e24eca7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:26.352555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab1c13-1ada-43c1-b187-605999557a35 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:26.370043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:26.370873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.370985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.371262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.372126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] RBAC: Adding query filter params (role.id=c55351f2719c4923ad693f939303165c, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=d58026a187ef48d69fa18853db63cd43) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:26.372440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:26.374012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:26.389429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 452/911] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:26 2022] GET /identity/v3/role_assignments?user.id=d58026a187ef48d69fa18853db63cd43&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=c55351f2719c4923ad693f939303165c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:26.396197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b079b-c607-4aa2-86de-910552040e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:26.397497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b079b-c607-4aa2-86de-910552040e09 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.398073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b079b-c607-4aa2-86de-910552040e09 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.398771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b079b-c607-4aa2-86de-910552040e09 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.399791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b079b-c607-4aa2-86de-910552040e09 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:26.401469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b079b-c607-4aa2-86de-910552040e09 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-a67b079b-c607-4aa2-86de-910552040e09 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:26.416116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:26.417109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:42:26.417977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:26.418749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 460/912] 10.222.0.69 () {56 vars in 1132 bytes} [Wed May 4 13:42:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:26.426041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:26.538401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcbceb-757c-41eb-b984-b82ce90d41c1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:26.547815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60299a-21e9-4797-b9fb-14c150874c02 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.548135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60299a-21e9-4797-b9fb-14c150874c02 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.548382 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60299a-21e9-4797-b9fb-14c150874c02 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.550305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 461/913] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:26.555947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb07b5-9700-4c1d-a270-80c49451d1b2 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.556275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb07b5-9700-4c1d-a270-80c49451d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.556515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb07b5-9700-4c1d-a270-80c49451d1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.574796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-91bb07b5-9700-4c1d-a270-80c49451d1b2 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:26.576029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-91bb07b5-9700-4c1d-a270-80c49451d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:26.582390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:26.583471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.583954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.585016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.586007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:26.586521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:26.589046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:26.597175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 453/914] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:26.603191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:26.653444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 462/915] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:26.676493 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb07b5-9700-4c1d-a270-80c49451d1b2 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:26.730812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c07613-93b2-45cf-9531-5ce6bdf593ed None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:26.772245 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:26.773357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.773872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.774378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.775349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:26.775876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:26.777562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:26.839411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb07b5-9700-4c1d-a270-80c49451d1b2 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:26.839626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 454/916] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:26.839626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:26.839769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878b2c5-edb8-4940-a389-b868622a4c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:26.839769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878b2c5-edb8-4940-a389-b868622a4c21 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.839769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878b2c5-edb8-4940-a389-b868622a4c21 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.839769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878b2c5-edb8-4940-a389-b868622a4c21 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.840063 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878b2c5-edb8-4940-a389-b868622a4c21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:26.840063 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878b2c5-edb8-4940-a389-b868622a4c21 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:26.905324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3457521-0503-4111-9df4-81e80954f870 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:26.940578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29586888-84bb-4211-8c66-c0885c6339e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:26.941270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29586888-84bb-4211-8c66-c0885c6339e8 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.941550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29586888-84bb-4211-8c66-c0885c6339e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.941833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29586888-84bb-4211-8c66-c0885c6339e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.942585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29586888-84bb-4211-8c66-c0885c6339e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:26.943987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29586888-84bb-4211-8c66-c0885c6339e8 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:26.985471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 463/917] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:42:26 2022] POST /identity/v3/services => generated 241 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:42:26.988090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06292d2-cabd-49db-9a28-6e4810de655d None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.988441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06292d2-cabd-49db-9a28-6e4810de655d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.988725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06292d2-cabd-49db-9a28-6e4810de655d None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:26.990562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 464/918] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:26.996662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bd1a2-13d4-4ce3-bbbe-799541e503ab None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:26.996957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bd1a2-13d4-4ce3-bbbe-799541e503ab None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:26.997356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bd1a2-13d4-4ce3-bbbe-799541e503ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:27.015894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-040bd1a2-13d4-4ce3-bbbe-799541e503ab None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:27.017164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-040bd1a2-13d4-4ce3-bbbe-799541e503ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:27.057948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 455/919] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:42:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:42:27.113332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 465/920] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:27.137643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29586888-84bb-4211-8c66-c0885c6339e8 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:27.260160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29586888-84bb-4211-8c66-c0885c6339e8 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:27.298151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:27.300055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:27.300055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:27.300055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:27.300681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:27.302186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:27.314507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:27.316069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:27.317411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 456/921] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:27.323206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bd1a2-13d4-4ce3-bbbe-799541e503ab None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:27.426831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bd1a2-13d4-4ce3-bbbe-799541e503ab None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:27.461779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:27.462453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:27.462741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:27.463021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:27.463740 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:27.464050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:27.465469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:27.471638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 466/922] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:27.477306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:27.581925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebbb8f-2f88-4a25-a241-6a78e4dd8153 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:27.616547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536861c-821d-46c9-9003-199e0b39bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:27.617256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536861c-821d-46c9-9003-199e0b39bf88 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:27.617554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536861c-821d-46c9-9003-199e0b39bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:27.618516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536861c-821d-46c9-9003-199e0b39bf88 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:27.618627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536861c-821d-46c9-9003-199e0b39bf88 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:27.618870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536861c-821d-46c9-9003-199e0b39bf88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:27.620317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536861c-821d-46c9-9003-199e0b39bf88 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:27.626568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 457/923] 10.222.0.69 () {56 vars in 1114 bytes} [Wed May 4 13:42:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:27.632440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:27.742995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797ea53-b4f3-4445-ad5b-b3e31ab1c036 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:27.777988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb76e5-b71c-41a4-b354-3ad56c65e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:27.778653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb76e5-b71c-41a4-b354-3ad56c65e3b2 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:27.778958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb76e5-b71c-41a4-b354-3ad56c65e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:27.779217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb76e5-b71c-41a4-b354-3ad56c65e3b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:27.779974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb76e5-b71c-41a4-b354-3ad56c65e3b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:27.781367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb76e5-b71c-41a4-b354-3ad56c65e3b2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:27.901161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 467/924] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:42:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:28.811845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c92dd-a4ae-4cbd-9bfd-b1fb23d47d13 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:28.812409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c92dd-a4ae-4cbd-9bfd-b1fb23d47d13 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:28.812409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c92dd-a4ae-4cbd-9bfd-b1fb23d47d13 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:28.814042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 458/925] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:28.819608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a5ca-9311-4644-b2ab-c9cdadc6f1c8 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:28.820075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a5ca-9311-4644-b2ab-c9cdadc6f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:28.820165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a5ca-9311-4644-b2ab-c9cdadc6f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:28.837345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5b74a5ca-9311-4644-b2ab-c9cdadc6f1c8 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:28.838521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5b74a5ca-9311-4644-b2ab-c9cdadc6f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:28.913477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 468/926] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:28.935548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c92dd-a4ae-4cbd-9bfd-b1fb23d47d13 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:29.039929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c92dd-a4ae-4cbd-9bfd-b1fb23d47d13 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:29.075346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ff7f1-f21c-4158-ab9c-433e1a0b21eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:29.076179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ff7f1-f21c-4158-ab9c-433e1a0b21eb None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.076449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ff7f1-f21c-4158-ab9c-433e1a0b21eb None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.076721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ff7f1-f21c-4158-ab9c-433e1a0b21eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.088015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ff7f1-f21c-4158-ab9c-433e1a0b21eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-e83ff7f1-f21c-4158-ab9c-433e1a0b21eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:29.096182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:29.098700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:29.100450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 459/927] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 13:42:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:29.105405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74a5ca-9311-4644-b2ab-c9cdadc6f1c8 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:29.215908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74a5ca-9311-4644-b2ab-c9cdadc6f1c8 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:29.255558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:29.256237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.256516 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.256794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.257627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:29.257986 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:29.259364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:29.269720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 469/928] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 13:42:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:29.274903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ff7f1-f21c-4158-ab9c-433e1a0b21eb None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:29.384681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ff7f1-f21c-4158-ab9c-433e1a0b21eb None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:29.419538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7897889-f17b-4d72-a883-dfaa3e86b32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:29.420332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897889-f17b-4d72-a883-dfaa3e86b32e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.420609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897889-f17b-4d72-a883-dfaa3e86b32e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.421033 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897889-f17b-4d72-a883-dfaa3e86b32e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.431596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7897889-f17b-4d72-a883-dfaa3e86b32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:29.433058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7897889-f17b-4d72-a883-dfaa3e86b32e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b7897889-f17b-4d72-a883-dfaa3e86b32e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:29.453956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:29.456273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:29.458596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:29.458596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:29.458596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:29.458596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:29.458596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 460/929] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:29.462823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:29.527618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bac84-09ed-45c2-9a50-57ae8bb5c91f None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.528255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bac84-09ed-45c2-9a50-57ae8bb5c91f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.528255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bac84-09ed-45c2-9a50-57ae8bb5c91f None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.530821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 461/930] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:29.535486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293da78-28c0-4e8b-b3c8-82fd1f975f0f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.535770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293da78-28c0-4e8b-b3c8-82fd1f975f0f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.536050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293da78-28c0-4e8b-b3c8-82fd1f975f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.553633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a293da78-28c0-4e8b-b3c8-82fd1f975f0f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:29.554847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a293da78-28c0-4e8b-b3c8-82fd1f975f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:29.571247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c70f-6dba-49e1-9bdf-23c89efa71f2 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:29.610794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:29.619568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.619568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.619568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.619568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:29.619568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:29.619568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:29.636609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 470/931] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:29.638008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:29.641360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 462/932] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:29.663992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293da78-28c0-4e8b-b3c8-82fd1f975f0f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:29.751012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb38583-7866-4cd6-9c6f-a158220d17d7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:29.793566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05f528-4c22-4eac-8d11-762c8f4f9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:29.793975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293da78-28c0-4e8b-b3c8-82fd1f975f0f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:29.794416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f528-4c22-4eac-8d11-762c8f4f9dbb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.794700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f528-4c22-4eac-8d11-762c8f4f9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.794977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f528-4c22-4eac-8d11-762c8f4f9dbb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.803533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05f528-4c22-4eac-8d11-762c8f4f9dbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:29.804992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05f528-4c22-4eac-8d11-762c8f4f9dbb None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-5e05f528-4c22-4eac-8d11-762c8f4f9dbb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:29.821790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:29.823250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:29.824207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 471/933] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:42:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:29.824845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104538a-a4bb-46b9-9e0f-400aaa11ee68 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.824845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104538a-a4bb-46b9-9e0f-400aaa11ee68 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.824845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104538a-a4bb-46b9-9e0f-400aaa11ee68 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.829379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 472/934] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:29.829379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104538a-a4bb-46b9-9e0f-400aaa11ee68 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:29.841933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6216a3-81fb-4ce6-b904-1d87c49afa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:29.842725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6216a3-81fb-4ce6-b904-1d87c49afa9b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.843174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6216a3-81fb-4ce6-b904-1d87c49afa9b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.843448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6216a3-81fb-4ce6-b904-1d87c49afa9b None admin] PATH_INFO: `/v3/services/compute` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.844109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6216a3-81fb-4ce6-b904-1d87c49afa9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:29.845505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6216a3-81fb-4ce6-b904-1d87c49afa9b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-0c6216a3-81fb-4ce6-b904-1d87c49afa9b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:29.858640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:29.859818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:29.860744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 463/935] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:29.862508 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f2eb1-d59b-483c-a9cc-8c5af0bfde4e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.862508 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f2eb1-d59b-483c-a9cc-8c5af0bfde4e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.862508 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f2eb1-d59b-483c-a9cc-8c5af0bfde4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.880847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-c56f2eb1-d59b-483c-a9cc-8c5af0bfde4e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:29.882048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c56f2eb1-d59b-483c-a9cc-8c5af0bfde4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:29.938850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104538a-a4bb-46b9-9e0f-400aaa11ee68 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:29.951359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 464/936] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:29.952495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f2eb1-d59b-483c-a9cc-8c5af0bfde4e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:29.982222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:29.983148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:29.983595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:29.983968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:29.984811 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:29.985106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:29.987371 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.004612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 473/937] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 13:42:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:30.006135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.061045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f2eb1-d59b-483c-a9cc-8c5af0bfde4e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.098810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.099479 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.099755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.100024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.100734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:30.101037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.102439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.107693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 465/938] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:30.108485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.116472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6db1f-7616-44b1-89c3-58c105b7e445 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.154542 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.155679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.156307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.156769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.157627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.159216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:30.171541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:30.173082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:30.175189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 474/939] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:30.176008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.219331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1942a6-25df-4bcd-b560-cf67db92ef45 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.254752 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.255529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.255825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.256079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.266264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.268477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.282966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f521-e165-4e11-8256-0709ba2431a7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:30.286473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:30.287550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:30.288636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:30.288636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:30.288636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:30.288636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:30.292319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 466/940] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:30.293171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.322003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.322872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.323106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.323378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.324093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:30.324414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.325784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.341599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 475/941] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:30.341599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.412642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f7e2-6ea5-4a40-91d5-5d347ba3275e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.460499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.461469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.461852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.462234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.463129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:30.463545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.465096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.475130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0012-cf74-4a4c-8da8-4acefd08c781 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.475704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 467/942] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:30.477770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.521611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.522293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.522577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.522855 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.524229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:30.524542 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.526408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.542849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 476/943] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:30.548367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.602300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe52e-126e-47b1-97ed-3da2408891e1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.640822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.641595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.641919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.642315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.643706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:30.644266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.645832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.651953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 468/944] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:30.657828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.671536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d28f1-bf7f-4576-bc02-cc871605ee70 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.712803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.713713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.714000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.714275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.722100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.723571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:30.739910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:30.745737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:30.746912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 477/945] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:30.747520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.787623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740c87b-2724-49a5-9c30-38057e4b27a4 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.830284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c07d28-d7fc-46b9-be09-7ad88c84fc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.830947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07d28-d7fc-46b9-be09-7ad88c84fc8b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.831325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07d28-d7fc-46b9-be09-7ad88c84fc8b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.831609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07d28-d7fc-46b9-be09-7ad88c84fc8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.832466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c07d28-d7fc-46b9-be09-7ad88c84fc8b None admin] RBAC: Adding query filter params (interface=public, service_id=3fe77a835a1e4e67b6222be5adce79ef, region_id=RegionOne) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:30.832784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c07d28-d7fc-46b9-be09-7ad88c84fc8b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.834199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c07d28-d7fc-46b9-be09-7ad88c84fc8b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.839929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 469/946] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/endpoints?service_id=3fe77a835a1e4e67b6222be5adce79ef&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:30.845420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4e1ef-3d8c-4217-9594-64970ea38633 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.846632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4e1ef-3d8c-4217-9594-64970ea38633 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.846632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4e1ef-3d8c-4217-9594-64970ea38633 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.848230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 470/947] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:30.848866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4e1ef-3d8c-4217-9594-64970ea38633 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:30.869731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c0063-67d5-4d9c-9b23-4cee02c8ce64 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.902709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b392c6-744b-4def-a839-fad350820577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.903424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b392c6-744b-4def-a839-fad350820577 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.903641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b392c6-744b-4def-a839-fad350820577 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.903927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b392c6-744b-4def-a839-fad350820577 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.904827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b392c6-744b-4def-a839-fad350820577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:30.905147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b392c6-744b-4def-a839-fad350820577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.906613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b392c6-744b-4def-a839-fad350820577 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.924970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 478/948] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:30.924970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2d3ad-b6d4-47ec-af7b-f0f7702393c2 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.924970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2d3ad-b6d4-47ec-af7b-f0f7702393c2 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.924970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2d3ad-b6d4-47ec-af7b-f0f7702393c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.941431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-86d2d3ad-b6d4-47ec-af7b-f0f7702393c2 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:30.942620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-86d2d3ad-b6d4-47ec-af7b-f0f7702393c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:30.952751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4e1ef-3d8c-4217-9594-64970ea38633 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:30.987337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163cdeb-9199-4be8-a06a-98119c599cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:30.988187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163cdeb-9199-4be8-a06a-98119c599cd1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:30.988489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163cdeb-9199-4be8-a06a-98119c599cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:30.988746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163cdeb-9199-4be8-a06a-98119c599cd1 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:30.989495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163cdeb-9199-4be8-a06a-98119c599cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:30.990930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163cdeb-9199-4be8-a06a-98119c599cd1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:30.996725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 471/949] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:42:30 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:42:30.997520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163cdeb-9199-4be8-a06a-98119c599cd1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:31.032104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 479/950] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:31.050920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2d3ad-b6d4-47ec-af7b-f0f7702393c2 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:31.146979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163cdeb-9199-4be8-a06a-98119c599cd1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:31.175211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2d3ad-b6d4-47ec-af7b-f0f7702393c2 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:31.188592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc251d7-9466-4b6a-8917-1df72e487f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:31.190560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc251d7-9466-4b6a-8917-1df72e487f38 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:31.191022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc251d7-9466-4b6a-8917-1df72e487f38 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:31.191495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc251d7-9466-4b6a-8917-1df72e487f38 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/d58026a187ef48d69fa18853db63cd43/roles/c55351f2719c4923ad693f939303165c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:31.195270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc251d7-9466-4b6a-8917-1df72e487f38 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=d58026a187ef48d69fa18853db63cd43, role_id=c55351f2719c4923ad693f939303165c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:31.197191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc251d7-9466-4b6a-8917-1df72e487f38 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:31.215372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:31.217631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:31.217631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:31.217631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:31.217887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:31.219131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:31.220501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING keystone.server.flask.common [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 13:42:31.263953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.sql.core [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 13:42:31.263953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 13:42:31.263953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [parameters: {'id': '9689bd9005f040439238093c14f6081a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 13:42:31.263953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91849) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9689bd9005f040439238093c14f6081a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9689bd9005f040439238093c14f6081a. May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application conn.query(q) May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:42:31.281093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application result.read() May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 13:42:31.282142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application next(self.gen) May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application yield resource May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application next(self.gen) May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self.session.rollback() May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self.force_reraise() May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise self.value May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application session.commit() May 04 13:42:31.283555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._prepare_impl() May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self.session.flush() May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._flush(objects) May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application compat.raise_( May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application flush_context.execute() May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 13:42:31.284711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rec.execute(self) May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 13:42:31.285663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application conn.query(q) May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application result.read() May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:42:31.286450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [parameters: {'id': '9689bd9005f040439238093c14f6081a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:31.287321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:31.289669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9689bd9005f040439238093c14f6081a. May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 480/951] 10.222.0.69 () {60 vars in 1140 bytes} [Wed May 4 13:42:31 2022] POST /identity/v3/projects => generated 262 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:31.291974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:31.305550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 472/952] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:42:30 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/d58026a187ef48d69fa18853db63cd43/roles/c55351f2719c4923ad693f939303165c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:42:31.415993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b0321-8a9d-44b2-9995-86147b6d3b11 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:31.455050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c90b88-2b97-47f9-9675-7f981dc0bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:31.456390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c90b88-2b97-47f9-9675-7f981dc0bc18 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:31.456975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c90b88-2b97-47f9-9675-7f981dc0bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:31.457485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c90b88-2b97-47f9-9675-7f981dc0bc18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:31.465841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c90b88-2b97-47f9-9675-7f981dc0bc18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:31.467988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c90b88-2b97-47f9-9675-7f981dc0bc18 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-07c90b88-2b97-47f9-9675-7f981dc0bc18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:31.483848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:31.484856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:31.485817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:31.485817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:31.485817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:31.485817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:31.485817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:31.485817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:31.485817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:31.485817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:31.488982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 481/953] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:31.495208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc251d7-9466-4b6a-8917-1df72e487f38 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:31.608668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc251d7-9466-4b6a-8917-1df72e487f38 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:31.644815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d32800-1282-4809-8ee9-025c1e989476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:31.645820 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d32800-1282-4809-8ee9-025c1e989476 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:31.646244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d32800-1282-4809-8ee9-025c1e989476 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:31.646675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d32800-1282-4809-8ee9-025c1e989476 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:31.647625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d32800-1282-4809-8ee9-025c1e989476 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:31.648151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d32800-1282-4809-8ee9-025c1e989476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:31.649768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d32800-1282-4809-8ee9-025c1e989476 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:31.669899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 473/954] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:32.702548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642867b-faa9-4e35-a6af-906da81bc239 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:32.703566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642867b-faa9-4e35-a6af-906da81bc239 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:32.704071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642867b-faa9-4e35-a6af-906da81bc239 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:32.709462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 482/955] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:32.714645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ca78-b8bd-4c5f-8874-7073be582739 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:32.715098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ca78-b8bd-4c5f-8874-7073be582739 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:32.715182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ca78-b8bd-4c5f-8874-7073be582739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:32.732995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4be6ca78-b8bd-4c5f-8874-7073be582739 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:32.734243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4be6ca78-b8bd-4c5f-8874-7073be582739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:32.806096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 474/956] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:32.829076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642867b-faa9-4e35-a6af-906da81bc239 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:32.938699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642867b-faa9-4e35-a6af-906da81bc239 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:32.974130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b219ac-83d6-4574-986c-1df91b3c7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:32.974720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b219ac-83d6-4574-986c-1df91b3c7543 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:32.975006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b219ac-83d6-4574-986c-1df91b3c7543 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:32.975286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b219ac-83d6-4574-986c-1df91b3c7543 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:32.976047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b219ac-83d6-4574-986c-1df91b3c7543 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:32.977446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b219ac-83d6-4574-986c-1df91b3c7543 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:33.071339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 483/957] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:42:32 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:33.325029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbedcf-2bcd-419a-bb22-dc02cd85d661 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:33.325354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbedcf-2bcd-419a-bb22-dc02cd85d661 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:33.325569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbedcf-2bcd-419a-bb22-dc02cd85d661 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:33.327084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 475/958] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:33.332621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133a5db-9832-4b31-b90d-bc8b88bc1eed None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:33.332937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133a5db-9832-4b31-b90d-bc8b88bc1eed None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:33.333231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133a5db-9832-4b31-b90d-bc8b88bc1eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:33.351508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1133a5db-9832-4b31-b90d-bc8b88bc1eed None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:33.353016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1133a5db-9832-4b31-b90d-bc8b88bc1eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:33.431317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 484/959] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:33.455370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbedcf-2bcd-419a-bb22-dc02cd85d661 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:33.564831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbedcf-2bcd-419a-bb22-dc02cd85d661 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:33.601851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2bb1-76bc-4322-a7fd-a006989a1437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:33.602666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2bb1-76bc-4322-a7fd-a006989a1437 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:33.602962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2bb1-76bc-4322-a7fd-a006989a1437 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:33.603243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2bb1-76bc-4322-a7fd-a006989a1437 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:33.603924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2bb1-76bc-4322-a7fd-a006989a1437 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:33.605704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2bb1-76bc-4322-a7fd-a006989a1437 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-40cf2bb1-76bc-4322-a7fd-a006989a1437 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:33.618716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:33.619776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:33.620605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 476/960] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:33.628234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133a5db-9832-4b31-b90d-bc8b88bc1eed None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:33.669868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d77e7-fff7-4907-a5d9-9dacdfd3ad35 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:33.670212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d77e7-fff7-4907-a5d9-9dacdfd3ad35 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:33.670431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d77e7-fff7-4907-a5d9-9dacdfd3ad35 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:33.672183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 477/961] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:33.678186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a3d6-1996-4854-80cc-54805d7a1f76 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:33.678742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a3d6-1996-4854-80cc-54805d7a1f76 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:33.679242 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a3d6-1996-4854-80cc-54805d7a1f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:33.697127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ca92a3d6-1996-4854-80cc-54805d7a1f76 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:33.698906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ca92a3d6-1996-4854-80cc-54805d7a1f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:33.735580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133a5db-9832-4b31-b90d-bc8b88bc1eed None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:33.775252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:33.776303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:33.776835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:33.777360 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:33.778299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:33.778865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:33.780504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:33.781572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 478/962] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:33.787141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 485/963] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:33.797020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a3d6-1996-4854-80cc-54805d7a1f76 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:33.798630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:33.900327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a3d6-1996-4854-80cc-54805d7a1f76 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:33.907398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef74f0-124d-4b94-adda-603a0bf81fea None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:33.936830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:33.937564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:33.937848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:33.938126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:33.938858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:33.939150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:33.941106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:33.945736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9318-6c7e-4eec-ab87-f7b815cacaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:33.946911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9318-6c7e-4eec-ab87-f7b815cacaa7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:33.947469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9318-6c7e-4eec-ab87-f7b815cacaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:33.947956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9318-6c7e-4eec-ab87-f7b815cacaa7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:33.951247 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 479/964] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:33.952190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:33.962431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c9318-6c7e-4eec-ab87-f7b815cacaa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-051c9318-6c7e-4eec-ab87-f7b815cacaa7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:33.972677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:33.973682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:33.974495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:33.982195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 486/965] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 13:42:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:33.983770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9318-6c7e-4eec-ab87-f7b815cacaa7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.054821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267937-84f4-42cb-8a2c-aad067920e03 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.087701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9318-6c7e-4eec-ab87-f7b815cacaa7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.092534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833f076-f992-45cf-9ef1-4ff49eaae39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.093190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833f076-f992-45cf-9ef1-4ff49eaae39e None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.093514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833f076-f992-45cf-9ef1-4ff49eaae39e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.093822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833f076-f992-45cf-9ef1-4ff49eaae39e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.094529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833f076-f992-45cf-9ef1-4ff49eaae39e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.096415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833f076-f992-45cf-9ef1-4ff49eaae39e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:34.124696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2fdf8-0836-4676-9818-b2439ad50b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.125403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2fdf8-0836-4676-9818-b2439ad50b86 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.125690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2fdf8-0836-4676-9818-b2439ad50b86 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.125969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2fdf8-0836-4676-9818-b2439ad50b86 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.126718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2fdf8-0836-4676-9818-b2439ad50b86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:34.127082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2fdf8-0836-4676-9818-b2439ad50b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.128454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2fdf8-0836-4676-9818-b2439ad50b86 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:34.136439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 487/966] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 13:42:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:34.137733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b96f9-50d0-4fac-bc19-0bd9b31b0340 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.138023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b96f9-50d0-4fac-bc19-0bd9b31b0340 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.138304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b96f9-50d0-4fac-bc19-0bd9b31b0340 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.141416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 488/967] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:34.142137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b96f9-50d0-4fac-bc19-0bd9b31b0340 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.184827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 480/968] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:42:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:42:34.198801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770686e-2a39-48b6-95bc-3c0f9a862476 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.204584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770686e-2a39-48b6-95bc-3c0f9a862476 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.204584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770686e-2a39-48b6-95bc-3c0f9a862476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.231250 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-2770686e-2a39-48b6-95bc-3c0f9a862476 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:34.232697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2770686e-2a39-48b6-95bc-3c0f9a862476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:34.273892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b96f9-50d0-4fac-bc19-0bd9b31b0340 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.317280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 481/969] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:34.323442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.324322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.324605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.324879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.337450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.339035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:34.340848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770686e-2a39-48b6-95bc-3c0f9a862476 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:34.366996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:34.367965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:34.368864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:34.368864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:34.368864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:34.368864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:34.373325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 489/970] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:34.374996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.476430 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770686e-2a39-48b6-95bc-3c0f9a862476 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.507877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93d81-c999-4bb1-b794-45cedfe826b6 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.520800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.521675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.522194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.522570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.524072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.526093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:34.527528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING keystone.server.flask.common [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 13:42:34.542723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.543390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.543735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.544017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.544783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:34.545149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.546508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:34.559879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 490/971] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:34.565398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.573004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.sql.core [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 13:42:34.573004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 13:42:34.573004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [parameters: {'user_id': 'fbd654a03f3542ee86a1154c0ea91e75', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 13:42:34.573004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91848) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application conn.query(q) May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result.read() May 04 13:42:34.585397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:42:34.586468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application next(self.gen) May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application yield resource May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application next(self.gen) May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.session.rollback() May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.force_reraise() May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise self.value May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application session.commit() May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 13:42:34.587456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._prepare_impl() May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.session.flush() May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._flush(objects) May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application compat.raise_( May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application flush_context.execute() May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rec.execute(self) May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 13:42:34.588421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:42:34.590525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application conn.query(q) May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application result.read() May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:42:34.597726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fbd654a03f3542ee86a1154c0ea91e75', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:34.600489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 13:42:34.602847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 13:42:34.607321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 13:42:34.607321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 13:42:34.607321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 13:42:34.607321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 13:42:34.607321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 13:42:34.607321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:34.607321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 482/972] 10.222.0.69 () {60 vars in 1131 bytes} [Wed May 4 13:42:34 2022] POST /identity/v3/users => generated 160 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:34.607321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.682310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712fb43-8682-49bf-b123-2b17ec5f82f2 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.711347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f805a4-99d8-484f-8554-7aa6178ed31a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.717826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.718690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.718977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.719249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.727652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.729017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:34.745637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:34.747122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:42:34.748107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:34.751631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 491/973] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:42:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:34.753261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.763330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.764391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.764827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.765271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.774866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.776698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:34.791786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:34.793312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:42:34.794253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:34.801313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 483/974] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:34.802471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.858586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6dc52-35e7-4455-bfe1-dd249bbac7fd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.894712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.895552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.896164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.896295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.897261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:34.897696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.899237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:34.909927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f34e0-5b5f-484c-8c18-8eeb5c714a7d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:34.923523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 492/975] 10.222.0.69 () {56 vars in 1149 bytes} [Wed May 4 13:42:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:34.925146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:34.945695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:34.946719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:34.947178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:34.947640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:34.948627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:34.949120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:34.950772 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:35.001423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 484/976] 10.222.0.69 () {56 vars in 1101 bytes} [Wed May 4 13:42:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:35.034614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33296071-e06e-4298-8910-80bcf62f168c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:35.074048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752a5a-3104-4bcf-841d-a148dde0f648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:35.074717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752a5a-3104-4bcf-841d-a148dde0f648 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.075049 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752a5a-3104-4bcf-841d-a148dde0f648 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.075334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752a5a-3104-4bcf-841d-a148dde0f648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.153577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62752a5a-3104-4bcf-841d-a148dde0f648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:35.155145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62752a5a-3104-4bcf-841d-a148dde0f648 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:35.261575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 493/977] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:34 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:35.267200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:35.379895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617ee85-0f17-4dcf-85c8-53fb43e6e222 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:35.413952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09b574-45e6-4bbf-90ac-7bc9aac1396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:35.414754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09b574-45e6-4bbf-90ac-7bc9aac1396b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.415082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09b574-45e6-4bbf-90ac-7bc9aac1396b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.415314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09b574-45e6-4bbf-90ac-7bc9aac1396b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.426394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09b574-45e6-4bbf-90ac-7bc9aac1396b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:35.427855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09b574-45e6-4bbf-90ac-7bc9aac1396b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-0b09b574-45e6-4bbf-90ac-7bc9aac1396b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:35.445170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:35.446708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:35.447689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:35.447689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:35.447689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:35.447689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:35.449329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 485/978] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:35.452170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752a5a-3104-4bcf-841d-a148dde0f648 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:35.496099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515488-cf04-4f6a-9f06-a102b70b9eb7 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.496406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515488-cf04-4f6a-9f06-a102b70b9eb7 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.496688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515488-cf04-4f6a-9f06-a102b70b9eb7 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.498259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 486/979] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:35.503874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79c0c-5047-4d05-b1ea-ac9814017867 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.504162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79c0c-5047-4d05-b1ea-ac9814017867 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.504442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79c0c-5047-4d05-b1ea-ac9814017867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.521757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e6f79c0c-5047-4d05-b1ea-ac9814017867 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:35.523202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e6f79c0c-5047-4d05-b1ea-ac9814017867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:35.559174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752a5a-3104-4bcf-841d-a148dde0f648 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:35.593376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 487/980] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:35.600346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:35.601009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.601317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.601653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.602375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:35.602731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:35.604102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:35.620965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 494/981] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:35.622075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f79c0c-5047-4d05-b1ea-ac9814017867 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:35.626437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:35.738476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f79c0c-5047-4d05-b1ea-ac9814017867 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:35.750037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7fd6e-0411-44f3-b999-2e10d9561705 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:35.778318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:35.778972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.779256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.779534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.785576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:35.786365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.786580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:35.786701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.786915 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.787614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:35.788031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:35.788979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:35.801796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:35.802882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:35.809198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 495/982] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:35.810039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:35.812657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:35.814235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 488/983] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:35.815499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:35.815597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:35.915046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4390-db23-4492-86c0-87a4f14f70a5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:35.916607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e18c57-25df-4c45-b689-0dd7d4dd1cb2 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:35.949288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:35.949948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.950235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.950514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.951228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:35.951342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:35.951529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:35.952066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:35.952349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:35.952625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:35.952898 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:35.953455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:35.953767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:35.955702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:35.959149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 496/984] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:35.964465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:35.974923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 489/985] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:35.976120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:36.067707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f1517-758b-4044-b56a-5257cc332d97 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:36.076828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e73904-d593-4386-98e4-55f1fd3ec789 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:36.103978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:36.104647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:36.104934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:36.105496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:36.106220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] RBAC: Adding query filter params (type=compute) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:36.106532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:36.107914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:36.118751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:36.118970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 497/986] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:36.119090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:36.119090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:36.119090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:36.119090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] RBAC: Adding query filter params (role.id=c55351f2719c4923ad693f939303165c, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=d58026a187ef48d69fa18853db63cd43) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:36.119090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:36.119090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:36.120061 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:36.124317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 490/987] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:35 2022] GET /identity/v3/role_assignments?user.id=d58026a187ef48d69fa18853db63cd43&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=c55351f2719c4923ad693f939303165c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:36.231493 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc4f9a-4198-4157-8f84-b43c1e7254cd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:36.266998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13e856-921d-49d7-96e4-8017fe510dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:36.267872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e856-921d-49d7-96e4-8017fe510dca None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:36.268198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e856-921d-49d7-96e4-8017fe510dca None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:36.269015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13e856-921d-49d7-96e4-8017fe510dca None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:36.269558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13e856-921d-49d7-96e4-8017fe510dca None admin] RBAC: Adding query filter params (interface=public, service_id=8396451a36334b8cb85433a2a8e5bcb2, region_id=RegionOne) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:36.269877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13e856-921d-49d7-96e4-8017fe510dca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:36.271286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13e856-921d-49d7-96e4-8017fe510dca None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:36.282035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 498/988] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 13:42:36 2022] GET /identity/v3/endpoints?service_id=8396451a36334b8cb85433a2a8e5bcb2&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:36.283057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:36.395447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854f01-cb8a-469e-9fe4-e73356671e23 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:36.430156 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6adb37-0c0e-4bf0-ad9b-6928aa07024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:36.430878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6adb37-0c0e-4bf0-ad9b-6928aa07024f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:36.431168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6adb37-0c0e-4bf0-ad9b-6928aa07024f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:36.431445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6adb37-0c0e-4bf0-ad9b-6928aa07024f None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:36.432144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6adb37-0c0e-4bf0-ad9b-6928aa07024f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:36.433527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6adb37-0c0e-4bf0-ad9b-6928aa07024f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:36.440842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 491/989] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:42:36 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:42:36.565675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277959-5cf5-4647-b899-5658927c717a None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:36.566036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277959-5cf5-4647-b899-5658927c717a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:36.566241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98277959-5cf5-4647-b899-5658927c717a None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:36.567838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 499/990] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:36.573524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114583e-ef8a-427e-83ee-c0f99b80d4e0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:36.573808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114583e-ef8a-427e-83ee-c0f99b80d4e0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:36.574079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114583e-ef8a-427e-83ee-c0f99b80d4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:36.592092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-f114583e-ef8a-427e-83ee-c0f99b80d4e0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:36.593316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f114583e-ef8a-427e-83ee-c0f99b80d4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:36.666795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 492/991] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:36.690340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277959-5cf5-4647-b899-5658927c717a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:36.795840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98277959-5cf5-4647-b899-5658927c717a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:36.832677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:36.833523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:36.833781 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:36.834052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:36.834714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:36.836072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:36.850122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:36.851431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:36.852298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:36.853916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 500/992] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:36.857807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114583e-ef8a-427e-83ee-c0f99b80d4e0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:36.957464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114583e-ef8a-427e-83ee-c0f99b80d4e0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:36.991509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:36.992503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:36.992959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:36.993445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:36.994323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:36.994823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:36.996356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:37.005438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 493/993] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:37.008224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:37.109043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35d399-6281-4c75-b279-b5bf503cef69 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:37.143714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:37.144452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:37.144739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:37.145017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:37.145769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:37.146080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:37.147515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:37.157317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 501/994] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:37.159174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:37.259857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109fc86-c1a4-4732-95d6-62aaf339b577 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:37.294708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55109a7d-37fd-42e3-842f-fbd3c7293c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:37.295398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109a7d-37fd-42e3-842f-fbd3c7293c80 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:37.295683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109a7d-37fd-42e3-842f-fbd3c7293c80 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:37.295963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109a7d-37fd-42e3-842f-fbd3c7293c80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:37.296844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55109a7d-37fd-42e3-842f-fbd3c7293c80 None admin] RBAC: Adding query filter params (interface=admin, service_id=3fe77a835a1e4e67b6222be5adce79ef, region_id=RegionOne) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:37.297163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55109a7d-37fd-42e3-842f-fbd3c7293c80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:37.299531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55109a7d-37fd-42e3-842f-fbd3c7293c80 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:37.309508 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 494/995] 10.222.0.69 () {56 vars in 1249 bytes} [Wed May 4 13:42:37 2022] GET /identity/v3/endpoints?service_id=3fe77a835a1e4e67b6222be5adce79ef&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:37.312103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:37.411490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4fe22-fce9-4325-a59e-fbadc189ca3d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:37.444515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3158c-46dc-4c82-b5db-a11542f55d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:37.445191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3158c-46dc-4c82-b5db-a11542f55d3a None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:37.445506 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3158c-46dc-4c82-b5db-a11542f55d3a None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:37.445787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3158c-46dc-4c82-b5db-a11542f55d3a None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:37.446474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3158c-46dc-4c82-b5db-a11542f55d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:37.447875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3158c-46dc-4c82-b5db-a11542f55d3a None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:37.461482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 502/996] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:42:37 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:42:38.460336 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ad9d0-bcca-4f24-b4c7-98eabcba7ac7 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:38.460861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ad9d0-bcca-4f24-b4c7-98eabcba7ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:38.460971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ad9d0-bcca-4f24-b4c7-98eabcba7ac7 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:38.462412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 495/997] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:38.467871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46159-2506-4913-af92-040fc7f0f82b None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:38.468342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46159-2506-4913-af92-040fc7f0f82b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:38.468441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46159-2506-4913-af92-040fc7f0f82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:38.487284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ccf46159-2506-4913-af92-040fc7f0f82b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:38.488618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ccf46159-2506-4913-af92-040fc7f0f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:38.555251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 503/998] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:38.578698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ad9d0-bcca-4f24-b4c7-98eabcba7ac7 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:38.693855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ad9d0-bcca-4f24-b4c7-98eabcba7ac7 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:38.728983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf290722-eeef-49e9-8ef0-e0c292b93e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:38.729721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf290722-eeef-49e9-8ef0-e0c292b93e69 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:38.730004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf290722-eeef-49e9-8ef0-e0c292b93e69 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:38.730538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf290722-eeef-49e9-8ef0-e0c292b93e69 None admin] PATH_INFO: `/v3/services/image` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:38.731193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf290722-eeef-49e9-8ef0-e0c292b93e69 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:38.732561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf290722-eeef-49e9-8ef0-e0c292b93e69 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-bf290722-eeef-49e9-8ef0-e0c292b93e69 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:38.751011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:38.752643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:38.753522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:38.760179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 496/999] 10.222.0.69 () {56 vars in 1105 bytes} [Wed May 4 13:42:38 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:38.761922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46159-2506-4913-af92-040fc7f0f82b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:38.773460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e5b60-7acf-4b40-acff-37bb9c6f8dde None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:38.773750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e5b60-7acf-4b40-acff-37bb9c6f8dde None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:38.774011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e5b60-7acf-4b40-acff-37bb9c6f8dde None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:38.775528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 497/1000] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:38.780338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25804ea-83dd-40e2-af6c-bd5069cda1c7 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:38.780825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25804ea-83dd-40e2-af6c-bd5069cda1c7 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:38.781084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25804ea-83dd-40e2-af6c-bd5069cda1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:38.797765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a25804ea-83dd-40e2-af6c-bd5069cda1c7 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:38.799861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a25804ea-83dd-40e2-af6c-bd5069cda1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:38.869376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 498/1001] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:38.875228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46159-2506-4913-af92-040fc7f0f82b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:38.893108 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25804ea-83dd-40e2-af6c-bd5069cda1c7 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:38.911302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:38.912526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:38.912953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:38.913395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:38.914242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] RBAC: Adding query filter params (name=image) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:38.915126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:38.916888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:38.924380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 504/1002] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:38.929422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:38.996406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25804ea-83dd-40e2-af6c-bd5069cda1c7 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:39.033453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:39.035217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:39.035705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:39.036197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] PATH_INFO: `/v3/services/compute` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:39.037059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:39.038615 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:39.045219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b80b6-9a4e-4faf-afbe-c4c15301e00a None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:39.052077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:39.053122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:42:39.054349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:39.057571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 499/1003] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:39.059375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:39.083978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:39.084952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:39.085267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:39.085543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:39.086341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] RBAC: Adding query filter params (type=image) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:39.086648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:39.088023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:39.092626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 505/1004] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:39.172102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8903f4-ecf1-4e3b-9017-9d174544f50e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:39.211677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:39.212624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:39.213079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:39.213541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:39.214442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:39.214909 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:39.216466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:39.223323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 500/1005] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:39.228957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:39.335925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638b96-ca30-4f52-bf1c-00e40a2b2e59 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:39.374135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1c7fd-371a-4543-8fdc-2a5d4f2fe6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:39.375415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c7fd-371a-4543-8fdc-2a5d4f2fe6e9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:39.375415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c7fd-371a-4543-8fdc-2a5d4f2fe6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:39.375415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c7fd-371a-4543-8fdc-2a5d4f2fe6e9 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:39.375995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1c7fd-371a-4543-8fdc-2a5d4f2fe6e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:39.376305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1c7fd-371a-4543-8fdc-2a5d4f2fe6e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:39.378277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1c7fd-371a-4543-8fdc-2a5d4f2fe6e9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:39.383738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 506/1006] 10.222.0.69 () {56 vars in 1112 bytes} [Wed May 4 13:42:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:39.394102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:39.504226 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cfd8e-835c-4e2d-8bdc-d47e352ab410 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:39.540477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b559483-5ca7-41ed-89dc-b1a2e912c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:39.541529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559483-5ca7-41ed-89dc-b1a2e912c2cb None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:39.542012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559483-5ca7-41ed-89dc-b1a2e912c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:39.542507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b559483-5ca7-41ed-89dc-b1a2e912c2cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:39.543449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559483-5ca7-41ed-89dc-b1a2e912c2cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:39.545270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b559483-5ca7-41ed-89dc-b1a2e912c2cb None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:39.642498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 501/1007] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:42:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:39.787125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62480a-0450-46bf-a1de-dd61a20196bd None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:39.787686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62480a-0450-46bf-a1de-dd61a20196bd None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:39.787686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62480a-0450-46bf-a1de-dd61a20196bd None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:39.789136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 507/1008] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:39.795601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a3868-e4d3-482f-8208-c70386f953f8 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:39.795914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a3868-e4d3-482f-8208-c70386f953f8 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:39.796181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a3868-e4d3-482f-8208-c70386f953f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:39.815493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e72a3868-e4d3-482f-8208-c70386f953f8 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:39.816736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e72a3868-e4d3-482f-8208-c70386f953f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:39.901775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 502/1009] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:39 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:39.926212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62480a-0450-46bf-a1de-dd61a20196bd None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:40.039339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62480a-0450-46bf-a1de-dd61a20196bd None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:40.078103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:40.078921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:40.079199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:40.079473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:40.080824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:40.082420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:40.095114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:40.096262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:40.097481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 508/1010] 10.222.0.69 () {56 vars in 1126 bytes} [Wed May 4 13:42:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:40.104674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a3868-e4d3-482f-8208-c70386f953f8 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:40.213819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a3868-e4d3-482f-8208-c70386f953f8 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:40.249548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:40.250280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:40.250567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:40.250849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:40.251564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:40.252105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:40.253402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:40.258771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 503/1011] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:40.264297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:40.368399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2a7b-44a4-46fa-8f26-88a3ecd69f0a None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:40.403648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92de0a-df33-4247-a6ec-28c272a72ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:40.404322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92de0a-df33-4247-a6ec-28c272a72ded None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:40.404676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92de0a-df33-4247-a6ec-28c272a72ded None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:40.404886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92de0a-df33-4247-a6ec-28c272a72ded None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:40.405709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92de0a-df33-4247-a6ec-28c272a72ded None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:40.406017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92de0a-df33-4247-a6ec-28c272a72ded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:40.407445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92de0a-df33-4247-a6ec-28c272a72ded None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:40.413416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 509/1012] 10.222.0.69 () {56 vars in 1122 bytes} [Wed May 4 13:42:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:40.419096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:40.524399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fbb17-c2e3-4062-b062-fcaa16f84fca None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:40.559068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b3126-607e-4693-b66e-5c29b36effd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:40.559720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b3126-607e-4693-b66e-5c29b36effd2 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:40.559999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b3126-607e-4693-b66e-5c29b36effd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:40.560271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b3126-607e-4693-b66e-5c29b36effd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:40.561018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b3126-607e-4693-b66e-5c29b36effd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:40.562484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b3126-607e-4693-b66e-5c29b36effd2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:40.654154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 504/1013] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:42:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:41.474366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eef851-acb3-4768-a58b-68d7f820d176 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:41.474937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eef851-acb3-4768-a58b-68d7f820d176 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:41.474937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eef851-acb3-4768-a58b-68d7f820d176 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:41.476455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 510/1014] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:41.485619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b47494-46c0-442e-bee8-2985172fae89 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:41.485917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b47494-46c0-442e-bee8-2985172fae89 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:41.486237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b47494-46c0-442e-bee8-2985172fae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:41.505961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-c9b47494-46c0-442e-bee8-2985172fae89 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:41.507141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c9b47494-46c0-442e-bee8-2985172fae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:41.581327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 505/1015] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:41 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:41.604426 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eef851-acb3-4768-a58b-68d7f820d176 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:41.708883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eef851-acb3-4768-a58b-68d7f820d176 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:41.742906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f9adb-d746-452d-b271-50f1be68fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:41.743492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f9adb-d746-452d-b271-50f1be68fe5d None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:41.743763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f9adb-d746-452d-b271-50f1be68fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:41.744044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f9adb-d746-452d-b271-50f1be68fe5d None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:41.747717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f9adb-d746-452d-b271-50f1be68fe5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:41.747717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f9adb-d746-452d-b271-50f1be68fe5d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:41.882567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 511/1016] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:42:41 2022] POST /identity/v3/services => generated 242 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:42.063795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05071d1-2b46-4aee-b3cb-3bea4f739783 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.064091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05071d1-2b46-4aee-b3cb-3bea4f739783 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.064340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05071d1-2b46-4aee-b3cb-3bea4f739783 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.066001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 506/1017] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:42.071306 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e27d70-61de-4bd9-ab16-07b073252662 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.071591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e27d70-61de-4bd9-ab16-07b073252662 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.071872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e27d70-61de-4bd9-ab16-07b073252662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.089824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-33e27d70-61de-4bd9-ab16-07b073252662 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:42.091002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-33e27d70-61de-4bd9-ab16-07b073252662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:42.164812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 512/1018] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:42.187695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05071d1-2b46-4aee-b3cb-3bea4f739783 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:42.293459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05071d1-2b46-4aee-b3cb-3bea4f739783 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:42.327499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2efc7-ec3e-497d-bcaf-fa8ace266b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:42.328233 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2efc7-ec3e-497d-bcaf-fa8ace266b41 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.328513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2efc7-ec3e-497d-bcaf-fa8ace266b41 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.328788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2efc7-ec3e-497d-bcaf-fa8ace266b41 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.339262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2efc7-ec3e-497d-bcaf-fa8ace266b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-a7d2efc7-ec3e-497d-bcaf-fa8ace266b41 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:42.347981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:42.349004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:42.349852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:42.350633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 507/1019] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 13:42:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:42.355635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e27d70-61de-4bd9-ab16-07b073252662 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:42.451577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e27d70-61de-4bd9-ab16-07b073252662 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:42.485692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:42.487028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.487150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.487422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.488160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:42.488489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:42.489943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:42.503747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 513/1020] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 13:42:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:42.505184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2efc7-ec3e-497d-bcaf-fa8ace266b41 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:42.608564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2efc7-ec3e-497d-bcaf-fa8ace266b41 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:42.643567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:42.644434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.644724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.645001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.656185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:42.657735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:42.675996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:42.677086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:42.678162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:42.678162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:42.678162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:42.678162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:42.678162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 508/1021] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:42.684267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:42.791281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d34b4-d34b-4934-b9d4-6d2b5a9a0cfc None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:42.828467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7f188-3bb2-4f56-b4ba-f945b404e920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:42.829120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7f188-3bb2-4f56-b4ba-f945b404e920 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.829433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7f188-3bb2-4f56-b4ba-f945b404e920 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.829707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7f188-3bb2-4f56-b4ba-f945b404e920 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.830981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7f188-3bb2-4f56-b4ba-f945b404e920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:42.831285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7f188-3bb2-4f56-b4ba-f945b404e920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:42.832641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7f188-3bb2-4f56-b4ba-f945b404e920 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:42.849113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 514/1022] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:42.850384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:42.952063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f68688-b645-4bc3-84c2-12a43d837817 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:42.978997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ce7e-a6e4-400c-b3aa-7e5a2888f0c0 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.979328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ce7e-a6e4-400c-b3aa-7e5a2888f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.979551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ce7e-a6e4-400c-b3aa-7e5a2888f0c0 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.981388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 515/1023] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:42.986183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e42da-80f6-446b-a463-b5b3532e37f8 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.987028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e42da-80f6-446b-a463-b5b3532e37f8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.987255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e42da-80f6-446b-a463-b5b3532e37f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.988480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:42.989382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:42.989678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:42.989963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:42.998005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:42.999455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:43.004498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0f0e42da-80f6-446b-a463-b5b3532e37f8 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:43.005857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0f0e42da-80f6-446b-a463-b5b3532e37f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:43.014083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:43.015327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:43.016816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 509/1024] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:42:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:43.022096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:43.082550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 516/1025] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:43.106365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e42da-80f6-446b-a463-b5b3532e37f8 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:43.126107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e148d-a7e6-4ff9-9e88-cfb823daa537 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:43.162592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:43.163274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:43.163560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:43.163838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:43.164781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:43.164992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:43.166453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:43.184815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 510/1026] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:42:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:43.190391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:43.211911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e42da-80f6-446b-a463-b5b3532e37f8 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:43.245806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940731d-7296-4295-8e84-50d48445004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:43.246593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940731d-7296-4295-8e84-50d48445004c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:43.246874 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940731d-7296-4295-8e84-50d48445004c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:43.247147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940731d-7296-4295-8e84-50d48445004c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:43.248313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940731d-7296-4295-8e84-50d48445004c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:43.249866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940731d-7296-4295-8e84-50d48445004c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:43.251481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 517/1027] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:43.257109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940731d-7296-4295-8e84-50d48445004c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:43.293855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0bb1-9aff-4678-8cb9-4fce32eb2038 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:43.329013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b781a6-b7e5-4e1e-bb0c-88a3d8fa3449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:43.330874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b781a6-b7e5-4e1e-bb0c-88a3d8fa3449 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:43.331161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b781a6-b7e5-4e1e-bb0c-88a3d8fa3449 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:43.331436 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b781a6-b7e5-4e1e-bb0c-88a3d8fa3449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:43.356180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940731d-7296-4295-8e84-50d48445004c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:43.391898 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc455c-f74f-4942-9ed8-3c3fa4b053fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:43.393084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc455c-f74f-4942-9ed8-3c3fa4b053fe None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:43.393398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc455c-f74f-4942-9ed8-3c3fa4b053fe None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:43.393680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc455c-f74f-4942-9ed8-3c3fa4b053fe None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:43.394561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc455c-f74f-4942-9ed8-3c3fa4b053fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:43.395989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc455c-f74f-4942-9ed8-3c3fa4b053fe None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:43.408095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b781a6-b7e5-4e1e-bb0c-88a3d8fa3449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:43.410094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b781a6-b7e5-4e1e-bb0c-88a3d8fa3449 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:43.508006 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 511/1028] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:43.513572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b781a6-b7e5-4e1e-bb0c-88a3d8fa3449 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:43.518134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 518/1029] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:42:43 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:42:43.628149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b781a6-b7e5-4e1e-bb0c-88a3d8fa3449 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:43.667612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:43.668520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:43.668797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:43.669068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:43.680756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:43.682267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:43.703165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:43.704130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:43.705918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:43.705918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:43.705918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:43.705918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:43.705918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 512/1030] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:43.712200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc455c-f74f-4942-9ed8-3c3fa4b053fe None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:43.821265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc455c-f74f-4942-9ed8-3c3fa4b053fe None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:43.855099 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:43.856020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:43.856299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:43.856574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:43.857321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:43.857629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:43.858995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:43.872491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 519/1031] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:43.878436 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:43.975984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b25d3-1de9-4f26-9dd1-d45e8a94c15e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:44.009395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:44.010108 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.010385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.010655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.018393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:44.019828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:44.034190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:44.035192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:44.036068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 513/1032] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:44.042720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:44.144048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dae9d-2749-4d46-b2bf-a10b437b4f63 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:44.178097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002c2e9-d5b7-47a7-ab55-259ea8c7897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:44.178756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c2e9-d5b7-47a7-ab55-259ea8c7897b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.179035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c2e9-d5b7-47a7-ab55-259ea8c7897b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.179345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002c2e9-d5b7-47a7-ab55-259ea8c7897b None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.180087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002c2e9-d5b7-47a7-ab55-259ea8c7897b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:44.180392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002c2e9-d5b7-47a7-ab55-259ea8c7897b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:44.181856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002c2e9-d5b7-47a7-ab55-259ea8c7897b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:44.194542 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 520/1033] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:44.200745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:44.234829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4927a-7e05-47f3-8aaf-ae5f79b0115c None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.235242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4927a-7e05-47f3-8aaf-ae5f79b0115c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.235414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4927a-7e05-47f3-8aaf-ae5f79b0115c None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.237312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 521/1034] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:44.242383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa896-d60d-4a5f-b66d-a664fa67270c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.242661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa896-d60d-4a5f-b66d-a664fa67270c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.242947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afa896-d60d-4a5f-b66d-a664fa67270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.260931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-53afa896-d60d-4a5f-b66d-a664fa67270c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:44.262066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-53afa896-d60d-4a5f-b66d-a664fa67270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:44.319368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402a7ac-32b3-4b19-ad17-ad0e79cf7bb6 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:44.328802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 522/1035] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:44.350981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afa896-d60d-4a5f-b66d-a664fa67270c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:44.356542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:44.357123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.357436 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.357716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.358559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] RBAC: Adding query filter params (role.id=c55351f2719c4923ad693f939303165c, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=f6da21ec482e47399411baa3c33f4f21) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:44.358873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:44.360316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:44.367908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 514/1036] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:44 2022] GET /identity/v3/role_assignments?user.id=f6da21ec482e47399411baa3c33f4f21&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=c55351f2719c4923ad693f939303165c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:44.461007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afa896-d60d-4a5f-b66d-a664fa67270c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:44.498830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:44.499901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.500333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.500750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] PATH_INFO: `/v3/services/image` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.501624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:44.503261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:44.515801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:44.517029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:44.518062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 523/1037] 10.222.0.69 () {56 vars in 1105 bytes} [Wed May 4 13:42:44 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:44.524289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:44.639731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d090e-343a-4c88-9925-9997035e3bda None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:44.676848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:44.677648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.677938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.678308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.679030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] RBAC: Adding query filter params (name=image) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:44.679339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:44.680739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:44.690710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 515/1038] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:44.691796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:44.800483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380c34-f75b-432d-a60b-62808838f396 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:44.835370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:44.836031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.836311 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.836586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.837345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] RBAC: Adding query filter params (type=image) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:44.837713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:44.838998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:44.848717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 524/1039] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:44.849824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:44.951912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577b2ad-d795-412e-8c11-fb054b9f1ffa None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:44.984325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b786f-f785-4e25-a770-5f5ce025c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:44.984989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b786f-f785-4e25-a770-5f5ce025c65a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:44.985296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b786f-f785-4e25-a770-5f5ce025c65a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:44.985577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b786f-f785-4e25-a770-5f5ce025c65a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:44.986950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b786f-f785-4e25-a770-5f5ce025c65a None admin] RBAC: Adding query filter params (interface=public, service_id=7f82b0c395fb4495a01911b1dff38b20, region_id=RegionOne) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:44.987262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b786f-f785-4e25-a770-5f5ce025c65a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:44.988748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b786f-f785-4e25-a770-5f5ce025c65a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:44.999818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 516/1040] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 13:42:44 2022] GET /identity/v3/endpoints?service_id=7f82b0c395fb4495a01911b1dff38b20&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:44.999997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:45.101324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641568-18b6-4a41-ba41-d982fd1a92ad None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:45.136339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc814-15d8-4e34-86df-4b8b4f99563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:45.137003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc814-15d8-4e34-86df-4b8b4f99563b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:45.137308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc814-15d8-4e34-86df-4b8b4f99563b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:45.137584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc814-15d8-4e34-86df-4b8b4f99563b None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:45.138272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc814-15d8-4e34-86df-4b8b4f99563b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:45.139626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc814-15d8-4e34-86df-4b8b4f99563b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:45.147129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 525/1041] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:42:44 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:42:45.912243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0e98c-33fe-4768-bb84-e36a71d1fccf None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:45.912767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0e98c-33fe-4768-bb84-e36a71d1fccf None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:45.913257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0e98c-33fe-4768-bb84-e36a71d1fccf None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:45.915938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 517/1042] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:45.921722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4c62-5c44-4ddf-b916-2b5c24f7c584 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:45.922218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4c62-5c44-4ddf-b916-2b5c24f7c584 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:45.922294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea4c62-5c44-4ddf-b916-2b5c24f7c584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:45.941622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-dbea4c62-5c44-4ddf-b916-2b5c24f7c584 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:45.942824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-dbea4c62-5c44-4ddf-b916-2b5c24f7c584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:46.022879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 526/1043] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:46.047947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0e98c-33fe-4768-bb84-e36a71d1fccf None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:46.155307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0e98c-33fe-4768-bb84-e36a71d1fccf None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:46.188796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12c5e6-3c46-4e9c-b618-8d15e4b2e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:46.190241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c5e6-3c46-4e9c-b618-8d15e4b2e7bc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.190520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c5e6-3c46-4e9c-b618-8d15e4b2e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.190790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c5e6-3c46-4e9c-b618-8d15e4b2e7bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.192024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12c5e6-3c46-4e9c-b618-8d15e4b2e7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:46.193492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12c5e6-3c46-4e9c-b618-8d15e4b2e7bc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:46.195336 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 518/1044] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:46.201041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea4c62-5c44-4ddf-b916-2b5c24f7c584 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:46.310445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea4c62-5c44-4ddf-b916-2b5c24f7c584 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:46.347603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554b90a-0e20-4e9e-bf4d-54db18c36248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:46.348278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554b90a-0e20-4e9e-bf4d-54db18c36248 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.348558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554b90a-0e20-4e9e-bf4d-54db18c36248 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.348829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554b90a-0e20-4e9e-bf4d-54db18c36248 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.349582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554b90a-0e20-4e9e-bf4d-54db18c36248 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:46.351011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554b90a-0e20-4e9e-bf4d-54db18c36248 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:46.464397 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 527/1045] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:42:46 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:46.662390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ab3d-9f03-42bf-aa9c-ee6b278f3ff2 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.662675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ab3d-9f03-42bf-aa9c-ee6b278f3ff2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.662951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ab3d-9f03-42bf-aa9c-ee6b278f3ff2 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.664536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 519/1046] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:46.670448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d54d8-a26d-45c3-87f2-9b9683e39d55 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.670748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d54d8-a26d-45c3-87f2-9b9683e39d55 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.671032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d54d8-a26d-45c3-87f2-9b9683e39d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.688519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-409d54d8-a26d-45c3-87f2-9b9683e39d55 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:46.690468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-409d54d8-a26d-45c3-87f2-9b9683e39d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:46.768809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 528/1047] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:46.792469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ab3d-9f03-42bf-aa9c-ee6b278f3ff2 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:46.901397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ab3d-9f03-42bf-aa9c-ee6b278f3ff2 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:46.935385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e08728-079f-41cf-9168-6da7eb391011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:46.936200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e08728-079f-41cf-9168-6da7eb391011 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.936427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e08728-079f-41cf-9168-6da7eb391011 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.936701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e08728-079f-41cf-9168-6da7eb391011 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.948219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e08728-079f-41cf-9168-6da7eb391011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-e9e08728-079f-41cf-9168-6da7eb391011 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:46.957128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:46.958330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:46.959456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:46.960724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 520/1048] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 13:42:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:46.964989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d54d8-a26d-45c3-87f2-9b9683e39d55 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.063176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d54d8-a26d-45c3-87f2-9b9683e39d55 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:47.097580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:47.098256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.098540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.098817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.099573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:47.099882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:47.101428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:47.110347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 529/1049] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 13:42:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:47.116473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e08728-079f-41cf-9168-6da7eb391011 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.216239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e08728-079f-41cf-9168-6da7eb391011 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:47.250501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:47.251308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.251592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.252116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.263650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:47.265215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:47.285400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:47.286389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:47.287313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:47.287313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:47.287313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:47.287313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:47.288122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 521/1050] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:47.292770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.395956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ed583-6f36-4ff6-b654-debb33fcd97c None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:47.431670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dbeab-179f-4534-9b48-b8d6e4e283cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:47.432332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dbeab-179f-4534-9b48-b8d6e4e283cb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.432617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dbeab-179f-4534-9b48-b8d6e4e283cb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.432926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dbeab-179f-4534-9b48-b8d6e4e283cb None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.433909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dbeab-179f-4534-9b48-b8d6e4e283cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:47.434219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dbeab-179f-4534-9b48-b8d6e4e283cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:47.435616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dbeab-179f-4534-9b48-b8d6e4e283cb None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:47.448499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 530/1051] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:47.454022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.460072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a4226-d144-4a29-b9ec-e82d9f82edf5 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.460370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a4226-d144-4a29-b9ec-e82d9f82edf5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.460643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a4226-d144-4a29-b9ec-e82d9f82edf5 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.462181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 531/1052] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:47.467224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ddf2-340d-40b0-b3b1-814e65f2f665 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.467457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ddf2-340d-40b0-b3b1-814e65f2f665 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.467739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ddf2-340d-40b0-b3b1-814e65f2f665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.485072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4e96ddf2-340d-40b0-b3b1-814e65f2f665 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:47.486911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4e96ddf2-340d-40b0-b3b1-814e65f2f665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:47.555297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 532/1053] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:47.562098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d4c0e-dc34-467f-9f6b-1b0be78d0ea0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:47.578154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96ddf2-340d-40b0-b3b1-814e65f2f665 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.598366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:47.599230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.599514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.599791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.607987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:47.609476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:47.625162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:47.626395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:47.627500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 522/1054] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:42:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:47.632622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.690123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96ddf2-340d-40b0-b3b1-814e65f2f665 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:47.728799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:47.729551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.729835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.730115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] PATH_INFO: `/v3/services/image` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.731077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:47.732467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:47.745527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556d974-8b40-40e0-b84a-fbcdbcc435bf None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:47.747498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:47.748597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:47.755324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 533/1055] 10.222.0.69 () {56 vars in 1105 bytes} [Wed May 4 13:42:47 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:47.758384 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.785990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:47.786668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.786964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.787222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.788063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:47.788368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:47.789836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:47.815351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 523/1056] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:42:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:47.816628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.874709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d3651-0978-4d21-b9dd-1665b4f50333 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:47.910508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:47.911187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.911473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.911753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.912475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] RBAC: Adding query filter params (name=image) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:47.912785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:47.914189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:47.919313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 534/1057] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:47.924994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:47.947703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3126483-9a28-43eb-8340-e022e099eafc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:47.985387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:47.986661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:47.987376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:47.987856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:47.998634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:48.000092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:48.018761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:48.019768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:48.020718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:48.020718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:48.020718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:48.020718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:48.020718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 524/1058] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:48.025918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:48.036607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ef9fe-e807-403d-962d-ff2a90fcae39 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:48.071846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:48.072522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.072848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.073130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.073887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] RBAC: Adding query filter params (type=image) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:48.074198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:48.075606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:48.086108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 535/1059] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:48.087415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:48.137200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79541ac0-79ca-406e-88cf-7444a8a43e22 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:48.174884 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:48.175559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.175840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.176626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.177588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:48.177899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:48.179659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:48.193490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 525/1060] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:48.199084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:48.204608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5f72-9ff2-4d51-9367-fe3f1dc21ae5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:48.243072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a0476-9295-4631-b5b0-e727fc577f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:48.243852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a0476-9295-4631-b5b0-e727fc577f60 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.243985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a0476-9295-4631-b5b0-e727fc577f60 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.244198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a0476-9295-4631-b5b0-e727fc577f60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.244951 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a0476-9295-4631-b5b0-e727fc577f60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:48.246346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a0476-9295-4631-b5b0-e727fc577f60 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:48.309977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0e8a3-0a35-45ee-b517-3ca43fb88f7c None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:48.357269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 536/1061] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:42:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:42:48.357487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:48.358027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.358482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.358642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.367576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:48.369086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:48.385796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:48.386914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:48.393837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 526/1062] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:48.394826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a0476-9295-4631-b5b0-e727fc577f60 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:48.508755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a0476-9295-4631-b5b0-e727fc577f60 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:48.548058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121eff2-ceba-4a67-b57b-8c1192c34d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:48.549470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121eff2-ceba-4a67-b57b-8c1192c34d10 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.549762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121eff2-ceba-4a67-b57b-8c1192c34d10 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.550032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121eff2-ceba-4a67-b57b-8c1192c34d10 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.550858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121eff2-ceba-4a67-b57b-8c1192c34d10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:48.551154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121eff2-ceba-4a67-b57b-8c1192c34d10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:48.552603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121eff2-ceba-4a67-b57b-8c1192c34d10 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:48.567314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 537/1063] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:48.573255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:48.682650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d668bb-3043-4fac-8d9d-d0ba056fc57e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:48.716882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e93ca-c084-44ea-8538-74772ed143b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:48.717824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e93ca-c084-44ea-8538-74772ed143b0 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.718106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e93ca-c084-44ea-8538-74772ed143b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.718378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e93ca-c084-44ea-8538-74772ed143b0 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/f6da21ec482e47399411baa3c33f4f21/roles/c55351f2719c4923ad693f939303165c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.720561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e93ca-c084-44ea-8538-74772ed143b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=f6da21ec482e47399411baa3c33f4f21, role_id=c55351f2719c4923ad693f939303165c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:48.722123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e93ca-c084-44ea-8538-74772ed143b0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:48.818637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 527/1064] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:42:48 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/f6da21ec482e47399411baa3c33f4f21/roles/c55351f2719c4923ad693f939303165c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:42:48.848839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e6ba-9b15-40a5-97d2-8cb5eb577316 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.849261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e6ba-9b15-40a5-97d2-8cb5eb577316 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.849614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e6ba-9b15-40a5-97d2-8cb5eb577316 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.851179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 538/1065] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:48.857569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff04f-20c1-4028-8bf4-ee0e83abc8fc None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.857906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff04f-20c1-4028-8bf4-ee0e83abc8fc None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.858142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff04f-20c1-4028-8bf4-ee0e83abc8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.876003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b8eff04f-20c1-4028-8bf4-ee0e83abc8fc None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:48.877876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b8eff04f-20c1-4028-8bf4-ee0e83abc8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:48.949985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 528/1066] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:48.974829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e6ba-9b15-40a5-97d2-8cb5eb577316 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:49.081314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e6ba-9b15-40a5-97d2-8cb5eb577316 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:49.116027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a768-9104-419b-8db8-6695c904523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:49.116821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a768-9104-419b-8db8-6695c904523b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:49.117107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a768-9104-419b-8db8-6695c904523b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:49.117415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a768-9104-419b-8db8-6695c904523b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:49.128398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879a768-9104-419b-8db8-6695c904523b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-5879a768-9104-419b-8db8-6695c904523b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:49.135977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:49.136991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:49.138194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:49.139152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 539/1067] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:49.143929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eff04f-20c1-4028-8bf4-ee0e83abc8fc None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:49.246459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eff04f-20c1-4028-8bf4-ee0e83abc8fc None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:49.281383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:49.282055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:49.282338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:49.282613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:49.284267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:49.284612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:49.285991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:49.298827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 529/1068] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:49.300551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a768-9104-419b-8db8-6695c904523b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:49.401881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a768-9104-419b-8db8-6695c904523b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:49.435512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f444a7e-28ec-4600-9cae-ee7120876d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:49.436378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f444a7e-28ec-4600-9cae-ee7120876d44 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:49.436658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f444a7e-28ec-4600-9cae-ee7120876d44 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:49.436933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f444a7e-28ec-4600-9cae-ee7120876d44 None admin] PATH_INFO: `/v3/users/ab49a092e9084e11bc78db18a0ac671c` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:49.450479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f444a7e-28ec-4600-9cae-ee7120876d44 None admin] RBAC: Authorizing `identity:get_user(user_id=ab49a092e9084e11bc78db18a0ac671c)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:49.451958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f444a7e-28ec-4600-9cae-ee7120876d44 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:49.453921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 540/1069] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:42:49 2022] GET /identity/v3/users/ab49a092e9084e11bc78db18a0ac671c => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:49.459936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:49.560783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85135f30-f3f0-494d-a8cd-0ee706e10521 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:49.594348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70102c-0926-4952-8199-d9095c287bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:49.595960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70102c-0926-4952-8199-d9095c287bed None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:49.596443 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70102c-0926-4952-8199-d9095c287bed None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:49.596913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70102c-0926-4952-8199-d9095c287bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:49.671295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70102c-0926-4952-8199-d9095c287bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:49.673166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70102c-0926-4952-8199-d9095c287bed None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:49.776449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 530/1070] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:49.778256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f444a7e-28ec-4600-9cae-ee7120876d44 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:49.879320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f444a7e-28ec-4600-9cae-ee7120876d44 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:49.913444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01838-8f94-4ba6-b28c-193157909772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:49.914305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01838-8f94-4ba6-b28c-193157909772 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:49.914590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01838-8f94-4ba6-b28c-193157909772 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:49.914867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01838-8f94-4ba6-b28c-193157909772 None admin] PATH_INFO: `/v3/projects/90e071137a6940928001b7de44b93289` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:49.916041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01838-8f94-4ba6-b28c-193157909772 None admin] RBAC: Authorizing `identity:get_project(project_id=90e071137a6940928001b7de44b93289)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:49.917494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01838-8f94-4ba6-b28c-193157909772 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:49.919356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 541/1071] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:42:49 2022] GET /identity/v3/projects/90e071137a6940928001b7de44b93289 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:49.926115 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70102c-0926-4952-8199-d9095c287bed None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:50.027531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70102c-0926-4952-8199-d9095c287bed None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:50.064667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e31e16-da41-4e05-b807-961f5bae2f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:50.065826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31e16-da41-4e05-b807-961f5bae2f16 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:50.066325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31e16-da41-4e05-b807-961f5bae2f16 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:50.066824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31e16-da41-4e05-b807-961f5bae2f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:50.068450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e31e16-da41-4e05-b807-961f5bae2f16 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=90e071137a6940928001b7de44b93289, user.id=ab49a092e9084e11bc78db18a0ac671c) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:50.068996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e31e16-da41-4e05-b807-961f5bae2f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:50.071477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e31e16-da41-4e05-b807-961f5bae2f16 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:50.077971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 531/1072] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:49 2022] GET /identity/v3/role_assignments?user.id=ab49a092e9084e11bc78db18a0ac671c&scope.project.id=90e071137a6940928001b7de44b93289&role.id=f1d6bdc882c24a2a9389961135865317 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:50.682478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463fa60-580e-4f8e-92f8-c79273951dd0 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:50.683010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463fa60-580e-4f8e-92f8-c79273951dd0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:50.683010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463fa60-580e-4f8e-92f8-c79273951dd0 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:50.684412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 542/1073] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:50.690384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c16b-4e0c-48dd-bf3f-dd695faacbf1 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:50.690678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c16b-4e0c-48dd-bf3f-dd695faacbf1 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:50.690931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01c16b-4e0c-48dd-bf3f-dd695faacbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:50.707979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1e01c16b-4e0c-48dd-bf3f-dd695faacbf1 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:50.709139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1e01c16b-4e0c-48dd-bf3f-dd695faacbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:50.785271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 532/1074] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:50.806422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463fa60-580e-4f8e-92f8-c79273951dd0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:50.910799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463fa60-580e-4f8e-92f8-c79273951dd0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:50.947620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f0d03-56d3-472e-a1ab-85536cd6cf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:50.948181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0d03-56d3-472e-a1ab-85536cd6cf0e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:50.948460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0d03-56d3-472e-a1ab-85536cd6cf0e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:50.948729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f0d03-56d3-472e-a1ab-85536cd6cf0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.015867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f0d03-56d3-472e-a1ab-85536cd6cf0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:51.018234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f0d03-56d3-472e-a1ab-85536cd6cf0e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:51.106904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed172b2-7458-48b4-beec-c47aae4d3949 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.107447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed172b2-7458-48b4-beec-c47aae4d3949 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.107698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed172b2-7458-48b4-beec-c47aae4d3949 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.109321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 533/1075] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:51.114583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637281f-ac5a-4353-96c0-4fca195dc2ca None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.115092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637281f-ac5a-4353-96c0-4fca195dc2ca None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.115454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637281f-ac5a-4353-96c0-4fca195dc2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.125685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 543/1076] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:51.127973 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f0d03-56d3-472e-a1ab-85536cd6cf0e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:51.134298 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a637281f-ac5a-4353-96c0-4fca195dc2ca None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:51.135574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a637281f-ac5a-4353-96c0-4fca195dc2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:51.203708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 534/1077] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:51.227489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637281f-ac5a-4353-96c0-4fca195dc2ca None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:51.230869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f0d03-56d3-472e-a1ab-85536cd6cf0e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:51.265759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:51.266557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.266835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.267108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.278424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:51.279878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:51.300386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:51.301352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:51.302283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:51.302283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:51.302283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:51.302283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:51.307786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 544/1078] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:51.308678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:51.332772 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637281f-ac5a-4353-96c0-4fca195dc2ca None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:51.369571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f78b0-1488-4933-9011-985ca5cdc675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:51.370382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f78b0-1488-4933-9011-985ca5cdc675 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.370664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f78b0-1488-4933-9011-985ca5cdc675 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.370939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f78b0-1488-4933-9011-985ca5cdc675 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.381527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f78b0-1488-4933-9011-985ca5cdc675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-399f78b0-1488-4933-9011-985ca5cdc675 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:51.389602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:51.390563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:51.396979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 535/1079] 10.222.0.69 () {56 vars in 1120 bytes} [Wed May 4 13:42:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:51.399038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f78b0-1488-4933-9011-985ca5cdc675 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:51.409603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e639ed3-e3fd-481f-85a6-cef5a84296b5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:51.444472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:51.445325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.445684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.445977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.446709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:51.447016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:51.448399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:51.461064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 545/1080] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:51.506043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f78b0-1488-4933-9011-985ca5cdc675 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:51.542117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:51.542806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.543086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.543359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.544118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:51.544424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:51.545857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:51.555881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 536/1081] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 13:42:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:51.562598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:51.671602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2be17-2c83-4203-8add-ea73ab621232 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:51.708386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:51.710053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.710340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.710609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.722258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:51.723649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:51.743980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:51.745380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:51.746296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:51.746296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:51.746296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:51.746296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:51.746296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 546/1082] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:51.749643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:51.854542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83109-04bf-4737-813b-15e53a57d5bf None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:51.887395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:51.888051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.888328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.888599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.889345 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:51.889647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:51.890999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:51.903518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 537/1083] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:51.910044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.009326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639963a6-36bc-4f35-8b01-7248ff6f2698 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:52.042761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:52.043548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.043831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.044106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.052332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:52.053800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:42:52.068732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:52.069734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:52.070687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 547/1084] 10.222.0.69 () {56 vars in 1093 bytes} [Wed May 4 13:42:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:52.075777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.178322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741b128-742d-42d4-b48f-0411671a686e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:52.213521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7912575-6966-4695-afc6-6a8d021c59f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:52.214198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7912575-6966-4695-afc6-6a8d021c59f7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.214481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7912575-6966-4695-afc6-6a8d021c59f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.214757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7912575-6966-4695-afc6-6a8d021c59f7 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.215637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7912575-6966-4695-afc6-6a8d021c59f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:52.215947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7912575-6966-4695-afc6-6a8d021c59f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:52.217408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7912575-6966-4695-afc6-6a8d021c59f7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:52.234717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 538/1085] 10.222.0.69 () {56 vars in 1133 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:52.240983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.339746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147332c7-23e2-4de1-9917-ec031d557ea1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:52.346095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5aa2-c7fd-4927-8236-3a4db6350053 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.346358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5aa2-c7fd-4927-8236-3a4db6350053 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.346639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5aa2-c7fd-4927-8236-3a4db6350053 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.348011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 539/1086] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:52.353205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842ef5-ed3e-44f1-95ff-0e078fc7c34e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.353517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842ef5-ed3e-44f1-95ff-0e078fc7c34e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.353792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842ef5-ed3e-44f1-95ff-0e078fc7c34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.369948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-aa842ef5-ed3e-44f1-95ff-0e078fc7c34e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:52.371111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-aa842ef5-ed3e-44f1-95ff-0e078fc7c34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:52.373741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6f0fa-8294-4fb5-a566-e32ac2931cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:52.374385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6f0fa-8294-4fb5-a566-e32ac2931cd5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.374663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6f0fa-8294-4fb5-a566-e32ac2931cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.374935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6f0fa-8294-4fb5-a566-e32ac2931cd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.437432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 540/1087] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:42:52.445943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6f0fa-8294-4fb5-a566-e32ac2931cd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:52.449808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6f0fa-8294-4fb5-a566-e32ac2931cd5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:52.460311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842ef5-ed3e-44f1-95ff-0e078fc7c34e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.548148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 548/1088] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 13:42:52.554305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6f0fa-8294-4fb5-a566-e32ac2931cd5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.557220 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842ef5-ed3e-44f1-95ff-0e078fc7c34e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:52.592564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254ba3-9885-4af9-ae67-ef870a2014f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:52.593305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254ba3-9885-4af9-ae67-ef870a2014f1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.593588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254ba3-9885-4af9-ae67-ef870a2014f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.593862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254ba3-9885-4af9-ae67-ef870a2014f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.604286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9254ba3-9885-4af9-ae67-ef870a2014f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-f9254ba3-9885-4af9-ae67-ef870a2014f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:52.612126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:52.613516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 541/1089] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:52.620712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254ba3-9885-4af9-ae67-ef870a2014f1 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.654609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6f0fa-8294-4fb5-a566-e32ac2931cd5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:52.690235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:52.691020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.691303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.691582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.701383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:52.702815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:52.721979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254ba3-9885-4af9-ae67-ef870a2014f1 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:42:52.722160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:52.723345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:52.724337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:42:52.724337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:42:52.724337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:42:52.724337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:52.724337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 549/1090] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:52.728720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.757713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:52.758392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.758676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.758960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.759727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:52.760032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:52.761445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:52.770133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 542/1091] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:52.775951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.827389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ca06e-f88e-4f58-860d-c7ce1deada37 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:52.862107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:52.862656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.862939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.863213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.863937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:52.864241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:52.865624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:52.876380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f3e1-7f81-446a-a32c-54ee77ba64fa None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:52.876923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 550/1092] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:52.882605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.915511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce7797-8a44-42ea-acae-beb08ecd677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:52.916389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7797-8a44-42ea-acae-beb08ecd677e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:52.916690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7797-8a44-42ea-acae-beb08ecd677e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:52.916936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7797-8a44-42ea-acae-beb08ecd677e None admin] PATH_INFO: `/v3/users/ab49a092e9084e11bc78db18a0ac671c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:52.918223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce7797-8a44-42ea-acae-beb08ecd677e None admin] RBAC: Authorizing `identity:get_user(user_id=ab49a092e9084e11bc78db18a0ac671c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:52.919757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce7797-8a44-42ea-acae-beb08ecd677e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:52.921434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 543/1093] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/users/ab49a092e9084e11bc78db18a0ac671c => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:52.928727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce7797-8a44-42ea-acae-beb08ecd677e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:52.980692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ed43c-95c4-4400-8831-6044a8a154c7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:53.013619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:53.014411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:53.014692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:53.014977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:53.023336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:53.023701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce7797-8a44-42ea-acae-beb08ecd677e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:53.024778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:42:53.039424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:53.040413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:42:53.041392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 551/1094] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:42:53.046361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:53.056930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffea654-46fc-457c-add2-e34e82f2dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:53.057759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea654-46fc-457c-add2-e34e82f2dd7c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:53.058041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea654-46fc-457c-add2-e34e82f2dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:53.058337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea654-46fc-457c-add2-e34e82f2dd7c None admin] PATH_INFO: `/v3/projects/90e071137a6940928001b7de44b93289` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:53.059486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffea654-46fc-457c-add2-e34e82f2dd7c None admin] RBAC: Authorizing `identity:get_project(project_id=90e071137a6940928001b7de44b93289)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:53.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffea654-46fc-457c-add2-e34e82f2dd7c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:53.062775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 544/1095] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:42:52 2022] GET /identity/v3/projects/90e071137a6940928001b7de44b93289 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:53.069158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffea654-46fc-457c-add2-e34e82f2dd7c None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:53.143952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a264ab-181b-4170-bed8-94c762fc0953 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:53.165653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffea654-46fc-457c-add2-e34e82f2dd7c None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:53.177850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:53.178513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:53.178799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:53.179083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:53.179872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:53.180188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:53.181662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:53.193807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 552/1096] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:53.199711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:53.200449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2a0be-583d-481f-8651-e7a8ab62d0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:53.201379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a0be-583d-481f-8651-e7a8ab62d0fb None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:53.201664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a0be-583d-481f-8651-e7a8ab62d0fb None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:53.201945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a0be-583d-481f-8651-e7a8ab62d0fb None admin] PATH_INFO: `/v3/projects/90e071137a6940928001b7de44b93289/users/ab49a092e9084e11bc78db18a0ac671c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:53.203928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2a0be-583d-481f-8651-e7a8ab62d0fb None admin] RBAC: Authorizing `identity:create_grant(project_id=90e071137a6940928001b7de44b93289, user_id=ab49a092e9084e11bc78db18a0ac671c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:53.205448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2a0be-583d-481f-8651-e7a8ab62d0fb None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:53.291073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 545/1097] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:42:53 2022] PUT /identity/v3/projects/90e071137a6940928001b7de44b93289/users/ab49a092e9084e11bc78db18a0ac671c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:42:53.296169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e872bd2-8f8b-4923-9221-7eca8885e566 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:53.335509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be12ca0-0fdd-4337-9905-90dd7408491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:53.336180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12ca0-0fdd-4337-9905-90dd7408491e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:53.336530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12ca0-0fdd-4337-9905-90dd7408491e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:53.336809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be12ca0-0fdd-4337-9905-90dd7408491e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:53.337702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12ca0-0fdd-4337-9905-90dd7408491e None admin] RBAC: Adding query filter params (role.id=c55351f2719c4923ad693f939303165c, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=f6da21ec482e47399411baa3c33f4f21) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:53.338015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12ca0-0fdd-4337-9905-90dd7408491e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:53.339462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be12ca0-0fdd-4337-9905-90dd7408491e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:53.346733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 553/1098] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:53 2022] GET /identity/v3/role_assignments?user.id=f6da21ec482e47399411baa3c33f4f21&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=c55351f2719c4923ad693f939303165c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:42:55.566504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eed74-c47a-4ff4-95d2-ff3125fdf79b None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:55.567041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eed74-c47a-4ff4-95d2-ff3125fdf79b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:55.567041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eed74-c47a-4ff4-95d2-ff3125fdf79b None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:55.568429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 546/1099] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:55.573677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c2c2-0dbf-47df-ac7c-ccc81b127d5f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:55.574083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c2c2-0dbf-47df-ac7c-ccc81b127d5f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:55.574242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c2c2-0dbf-47df-ac7c-ccc81b127d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:55.590863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0b71c2c2-0dbf-47df-ac7c-ccc81b127d5f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:55.592049 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0b71c2c2-0dbf-47df-ac7c-ccc81b127d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:55.658897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 554/1100] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:55.683103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eed74-c47a-4ff4-95d2-ff3125fdf79b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:55.786259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eed74-c47a-4ff4-95d2-ff3125fdf79b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:55.819914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126c0ed-c0af-4f63-a384-fce8ac5a41ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:55.820675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c0ed-c0af-4f63-a384-fce8ac5a41ad None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:55.820965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c0ed-c0af-4f63-a384-fce8ac5a41ad None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:55.821274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126c0ed-c0af-4f63-a384-fce8ac5a41ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:55.833003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126c0ed-c0af-4f63-a384-fce8ac5a41ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-b126c0ed-c0af-4f63-a384-fce8ac5a41ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:42:55.840472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:42:55.841625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:42:55.842690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 547/1101] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:42:55.848365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71c2c2-0dbf-47df-ac7c-ccc81b127d5f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:55.944386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71c2c2-0dbf-47df-ac7c-ccc81b127d5f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:55.977688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:55.978350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:55.978637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:55.978912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:55.979655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:55.979960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:55.981606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:55.989565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 555/1102] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:55.995390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126c0ed-c0af-4f63-a384-fce8ac5a41ad None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:56.091845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126c0ed-c0af-4f63-a384-fce8ac5a41ad None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:56.125719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160be7bb-5eba-44c8-b428-c62b1fdc64fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:56.127141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be7bb-5eba-44c8-b428-c62b1fdc64fc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:56.127420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be7bb-5eba-44c8-b428-c62b1fdc64fc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:56.127743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be7bb-5eba-44c8-b428-c62b1fdc64fc None admin] PATH_INFO: `/v3/users/ab49a092e9084e11bc78db18a0ac671c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:56.128982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160be7bb-5eba-44c8-b428-c62b1fdc64fc None admin] RBAC: Authorizing `identity:get_user(user_id=ab49a092e9084e11bc78db18a0ac671c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:56.130581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160be7bb-5eba-44c8-b428-c62b1fdc64fc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:56.132256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 548/1103] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:42:55 2022] GET /identity/v3/users/ab49a092e9084e11bc78db18a0ac671c => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:56.138064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:56.234952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038e7f-f547-4eb6-a130-7cd3479ac89d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:56.269254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc832-7810-4339-be34-0d3603a2796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:56.269914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc832-7810-4339-be34-0d3603a2796d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:56.270197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc832-7810-4339-be34-0d3603a2796d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:56.270478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bc832-7810-4339-be34-0d3603a2796d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:56.334735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bc832-7810-4339-be34-0d3603a2796d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:56.336232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bc832-7810-4339-be34-0d3603a2796d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:56.429487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 556/1104] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:42:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:42:56.435343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160be7bb-5eba-44c8-b428-c62b1fdc64fc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:56.534804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160be7bb-5eba-44c8-b428-c62b1fdc64fc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:56.567818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5e60-6f5d-4a84-913a-79e6e6545544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:56.568678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5e60-6f5d-4a84-913a-79e6e6545544 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:56.568982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5e60-6f5d-4a84-913a-79e6e6545544 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:56.569299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5e60-6f5d-4a84-913a-79e6e6545544 None admin] PATH_INFO: `/v3/projects/90e071137a6940928001b7de44b93289` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:56.570485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5e60-6f5d-4a84-913a-79e6e6545544 None admin] RBAC: Authorizing `identity:get_project(project_id=90e071137a6940928001b7de44b93289)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:56.571911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5e60-6f5d-4a84-913a-79e6e6545544 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:56.573641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 549/1105] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:42:56 2022] GET /identity/v3/projects/90e071137a6940928001b7de44b93289 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:56.580657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc832-7810-4339-be34-0d3603a2796d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:56.679291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bc832-7810-4339-be34-0d3603a2796d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:56.712822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cd7ad-9060-477a-89a7-4817eda0cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:56.713418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cd7ad-9060-477a-89a7-4817eda0cee9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:56.713701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cd7ad-9060-477a-89a7-4817eda0cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:56.713974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cd7ad-9060-477a-89a7-4817eda0cee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:56.714800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cd7ad-9060-477a-89a7-4817eda0cee9 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=90e071137a6940928001b7de44b93289, user.id=ab49a092e9084e11bc78db18a0ac671c) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:42:56.715105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cd7ad-9060-477a-89a7-4817eda0cee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:56.716530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cd7ad-9060-477a-89a7-4817eda0cee9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:56.722965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 557/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:42:56 2022] GET /identity/v3/role_assignments?user.id=ab49a092e9084e11bc78db18a0ac671c&scope.project.id=90e071137a6940928001b7de44b93289&role.id=f1d6bdc882c24a2a9389961135865317 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:59.035429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61d02-099b-44dc-8f94-762c4e70f71a None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:59.035988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61d02-099b-44dc-8f94-762c4e70f71a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:59.035988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61d02-099b-44dc-8f94-762c4e70f71a None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:59.037290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 550/1107] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:59.042487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f409f-25b1-495b-b09a-fff5008bcd49 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:59.042910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f409f-25b1-495b-b09a-fff5008bcd49 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:59.043041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f409f-25b1-495b-b09a-fff5008bcd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:59.059387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-de4f409f-25b1-495b-b09a-fff5008bcd49 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:59.060669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-de4f409f-25b1-495b-b09a-fff5008bcd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:59.126006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 558/1108] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:42:59.151223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea61d02-099b-44dc-8f94-762c4e70f71a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:59.248654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea61d02-099b-44dc-8f94-762c4e70f71a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:59.281927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfef4a7-f4d4-44ee-bfb2-96ab5af17662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:59.282748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef4a7-f4d4-44ee-bfb2-96ab5af17662 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:59.283568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef4a7-f4d4-44ee-bfb2-96ab5af17662 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:59.283861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfef4a7-f4d4-44ee-bfb2-96ab5af17662 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:59.285045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfef4a7-f4d4-44ee-bfb2-96ab5af17662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:59.286555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfef4a7-f4d4-44ee-bfb2-96ab5af17662 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:59.288127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 551/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:42:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:42:59.293953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f409f-25b1-495b-b09a-fff5008bcd49 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:59.387432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f409f-25b1-495b-b09a-fff5008bcd49 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:59.419339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11f4ec-945e-4b82-976d-9d8758834868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:59.419995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f4ec-945e-4b82-976d-9d8758834868 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:59.420275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f4ec-945e-4b82-976d-9d8758834868 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:59.420549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f4ec-945e-4b82-976d-9d8758834868 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:59.421268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11f4ec-945e-4b82-976d-9d8758834868 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:59.422686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11f4ec-945e-4b82-976d-9d8758834868 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:59.567408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 559/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:42:59 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:43:01.901324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b31400-fee8-4833-98d0-331608d188a4 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:01.901882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b31400-fee8-4833-98d0-331608d188a4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:01.901882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b31400-fee8-4833-98d0-331608d188a4 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:01.903241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 552/1111] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:01.909046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae421-a209-4f9b-8033-c3bb6f000a1a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:01.909526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae421-a209-4f9b-8033-c3bb6f000a1a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:01.909635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae421-a209-4f9b-8033-c3bb6f000a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:01.926476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-52bae421-a209-4f9b-8033-c3bb6f000a1a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:01.927657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-52bae421-a209-4f9b-8033-c3bb6f000a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:01.991292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 560/1112] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:02.014814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b31400-fee8-4833-98d0-331608d188a4 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:02.119991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b31400-fee8-4833-98d0-331608d188a4 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:02.152593 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1c9a9-aced-40ab-b637-56a77c6ca520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:02.153468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1c9a9-aced-40ab-b637-56a77c6ca520 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:02.153753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1c9a9-aced-40ab-b637-56a77c6ca520 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:02.154027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1c9a9-aced-40ab-b637-56a77c6ca520 None admin] PATH_INFO: `/v3/roles/597c56383ca9464ca3bf4ae47dbf7716` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:02.155491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1c9a9-aced-40ab-b637-56a77c6ca520 None admin] RBAC: Authorizing `identity:get_role(role_id=597c56383ca9464ca3bf4ae47dbf7716)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:02.156854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1c9a9-aced-40ab-b637-56a77c6ca520 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:02.159288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 553/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:02 2022] GET /identity/v3/roles/597c56383ca9464ca3bf4ae47dbf7716 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:02.165092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bae421-a209-4f9b-8033-c3bb6f000a1a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:02.260276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bae421-a209-4f9b-8033-c3bb6f000a1a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:02.293194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d287c6-ab36-49c7-b320-fa1134070cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:02.294027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d287c6-ab36-49c7-b320-fa1134070cc1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:02.294309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d287c6-ab36-49c7-b320-fa1134070cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:02.294583 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d287c6-ab36-49c7-b320-fa1134070cc1 None admin] PATH_INFO: `/v3/users/0c75c4a291424cb79ab28fcd56ff7d63` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:02.307340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d287c6-ab36-49c7-b320-fa1134070cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=0c75c4a291424cb79ab28fcd56ff7d63)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:02.308783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d287c6-ab36-49c7-b320-fa1134070cc1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:02.310477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 561/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:02 2022] GET /identity/v3/users/0c75c4a291424cb79ab28fcd56ff7d63 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:02.316611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1c9a9-aced-40ab-b637-56a77c6ca520 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:02.413535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1c9a9-aced-40ab-b637-56a77c6ca520 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:02.446870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322bd1d-90f9-4d9a-b0d5-d998f9643e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:02.447525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bd1d-90f9-4d9a-b0d5-d998f9643e44 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:02.447808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bd1d-90f9-4d9a-b0d5-d998f9643e44 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:02.448085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bd1d-90f9-4d9a-b0d5-d998f9643e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:02.512723 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322bd1d-90f9-4d9a-b0d5-d998f9643e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:02.514211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322bd1d-90f9-4d9a-b0d5-d998f9643e44 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:02.608532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 554/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:43:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:43:02.614564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d287c6-ab36-49c7-b320-fa1134070cc1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:02.711446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d287c6-ab36-49c7-b320-fa1134070cc1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:02.743643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26468d-c5cf-4a6e-aa79-49bff56d7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:02.744491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26468d-c5cf-4a6e-aa79-49bff56d7712 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:02.744770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26468d-c5cf-4a6e-aa79-49bff56d7712 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:02.745041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26468d-c5cf-4a6e-aa79-49bff56d7712 None admin] PATH_INFO: `/v3/projects/90e071137a6940928001b7de44b93289` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:02.746248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26468d-c5cf-4a6e-aa79-49bff56d7712 None admin] RBAC: Authorizing `identity:get_project(project_id=90e071137a6940928001b7de44b93289)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:02.747684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26468d-c5cf-4a6e-aa79-49bff56d7712 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:02.749553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 562/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:02 2022] GET /identity/v3/projects/90e071137a6940928001b7de44b93289 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:02.756241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322bd1d-90f9-4d9a-b0d5-d998f9643e44 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:02.878771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322bd1d-90f9-4d9a-b0d5-d998f9643e44 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:02.918364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc5edb-b29d-4b1e-ba8e-d4b0742506e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:02.919043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc5edb-b29d-4b1e-ba8e-d4b0742506e7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:02.919282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc5edb-b29d-4b1e-ba8e-d4b0742506e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:02.919556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc5edb-b29d-4b1e-ba8e-d4b0742506e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:02.920396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc5edb-b29d-4b1e-ba8e-d4b0742506e7 None admin] RBAC: Adding query filter params (role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=90e071137a6940928001b7de44b93289, user.id=0c75c4a291424cb79ab28fcd56ff7d63) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:02.920704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc5edb-b29d-4b1e-ba8e-d4b0742506e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:02.922231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc5edb-b29d-4b1e-ba8e-d4b0742506e7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:02.929764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 555/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:43:02 2022] GET /identity/v3/role_assignments?user.id=0c75c4a291424cb79ab28fcd56ff7d63&scope.project.id=90e071137a6940928001b7de44b93289&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:05.186543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af82c43-28ea-4f1e-b998-70146adf5a60 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:05.187123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af82c43-28ea-4f1e-b998-70146adf5a60 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:05.187279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af82c43-28ea-4f1e-b998-70146adf5a60 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:05.188562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 563/1118] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:05.194452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96747-2c4e-419d-9ff3-2234b48288be None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:05.194923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96747-2c4e-419d-9ff3-2234b48288be None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:05.195026 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f96747-2c4e-419d-9ff3-2234b48288be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:05.212213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-81f96747-2c4e-419d-9ff3-2234b48288be None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:05.213427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-81f96747-2c4e-419d-9ff3-2234b48288be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:05.280901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 556/1119] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:05.305511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af82c43-28ea-4f1e-b998-70146adf5a60 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:05.418795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af82c43-28ea-4f1e-b998-70146adf5a60 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:05.452780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48482c-e26c-4846-8c97-9388c56d2e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:05.453590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48482c-e26c-4846-8c97-9388c56d2e4d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:05.453872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48482c-e26c-4846-8c97-9388c56d2e4d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:05.454144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48482c-e26c-4846-8c97-9388c56d2e4d None admin] PATH_INFO: `/v3/roles/597c56383ca9464ca3bf4ae47dbf7716` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:05.456504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48482c-e26c-4846-8c97-9388c56d2e4d None admin] RBAC: Authorizing `identity:get_role(role_id=597c56383ca9464ca3bf4ae47dbf7716)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:05.457906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48482c-e26c-4846-8c97-9388c56d2e4d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:05.459273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 564/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:05 2022] GET /identity/v3/roles/597c56383ca9464ca3bf4ae47dbf7716 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:05.465041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f96747-2c4e-419d-9ff3-2234b48288be None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:05.603786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f96747-2c4e-419d-9ff3-2234b48288be None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:05.653904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2686d9-174a-4c58-ac2b-c5fe8a67f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:05.654962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2686d9-174a-4c58-ac2b-c5fe8a67f520 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:05.655293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2686d9-174a-4c58-ac2b-c5fe8a67f520 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:05.655570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2686d9-174a-4c58-ac2b-c5fe8a67f520 None admin] PATH_INFO: `/v3/users/0c75c4a291424cb79ab28fcd56ff7d63` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:05.656783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2686d9-174a-4c58-ac2b-c5fe8a67f520 None admin] RBAC: Authorizing `identity:get_user(user_id=0c75c4a291424cb79ab28fcd56ff7d63)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:05.658858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2686d9-174a-4c58-ac2b-c5fe8a67f520 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:05.661705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 557/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:05 2022] GET /identity/v3/users/0c75c4a291424cb79ab28fcd56ff7d63 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:05.667940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48482c-e26c-4846-8c97-9388c56d2e4d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:05.776169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48482c-e26c-4846-8c97-9388c56d2e4d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:05.812245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492f74d-e636-407c-8c4a-528c6a6ef911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:05.813206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492f74d-e636-407c-8c4a-528c6a6ef911 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:05.813625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492f74d-e636-407c-8c4a-528c6a6ef911 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:05.813989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492f74d-e636-407c-8c4a-528c6a6ef911 None admin] PATH_INFO: `/v3/projects/90e071137a6940928001b7de44b93289` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:05.815929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492f74d-e636-407c-8c4a-528c6a6ef911 None admin] RBAC: Authorizing `identity:get_project(project_id=90e071137a6940928001b7de44b93289)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:05.817719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492f74d-e636-407c-8c4a-528c6a6ef911 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:05.819875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 565/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:05 2022] GET /identity/v3/projects/90e071137a6940928001b7de44b93289 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:05.826012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2686d9-174a-4c58-ac2b-c5fe8a67f520 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:05.924344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2686d9-174a-4c58-ac2b-c5fe8a67f520 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:05.957426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8be3-5e79-4410-a3fb-fd2df523954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:05.958313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8be3-5e79-4410-a3fb-fd2df523954d None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:05.958601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8be3-5e79-4410-a3fb-fd2df523954d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:05.958879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8be3-5e79-4410-a3fb-fd2df523954d None admin] PATH_INFO: `/v3/projects/90e071137a6940928001b7de44b93289/users/0c75c4a291424cb79ab28fcd56ff7d63/roles/597c56383ca9464ca3bf4ae47dbf7716` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:05.961072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc8be3-5e79-4410-a3fb-fd2df523954d None admin] RBAC: Authorizing `identity:create_grant(project_id=90e071137a6940928001b7de44b93289, user_id=0c75c4a291424cb79ab28fcd56ff7d63, role_id=597c56383ca9464ca3bf4ae47dbf7716)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:05.962522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc8be3-5e79-4410-a3fb-fd2df523954d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:06.081483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 558/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:43:05 2022] PUT /identity/v3/projects/90e071137a6940928001b7de44b93289/users/0c75c4a291424cb79ab28fcd56ff7d63/roles/597c56383ca9464ca3bf4ae47dbf7716 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:43:08.347399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65f55-89f0-4ad5-86ba-c2e4638860b0 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:08.347928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65f55-89f0-4ad5-86ba-c2e4638860b0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:08.348053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65f55-89f0-4ad5-86ba-c2e4638860b0 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:08.349379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 566/1124] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:08.354477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab289f-77d2-4f57-a137-3d41d76db281 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:08.354869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab289f-77d2-4f57-a137-3d41d76db281 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:08.355035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab289f-77d2-4f57-a137-3d41d76db281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:08.372087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-8cab289f-77d2-4f57-a137-3d41d76db281 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:08.373271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-8cab289f-77d2-4f57-a137-3d41d76db281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:08.436398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 559/1125] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:08.461195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a65f55-89f0-4ad5-86ba-c2e4638860b0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:08.558203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a65f55-89f0-4ad5-86ba-c2e4638860b0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:08.591234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e4394-2cb9-4752-b7d1-7c63cd46541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:08.592079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4394-2cb9-4752-b7d1-7c63cd46541e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:08.592365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4394-2cb9-4752-b7d1-7c63cd46541e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:08.592642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4394-2cb9-4752-b7d1-7c63cd46541e None admin] PATH_INFO: `/v3/roles/597c56383ca9464ca3bf4ae47dbf7716` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:08.594123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e4394-2cb9-4752-b7d1-7c63cd46541e None admin] RBAC: Authorizing `identity:get_role(role_id=597c56383ca9464ca3bf4ae47dbf7716)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:08.595619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e4394-2cb9-4752-b7d1-7c63cd46541e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:08.596987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 567/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:08 2022] GET /identity/v3/roles/597c56383ca9464ca3bf4ae47dbf7716 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:08.603076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab289f-77d2-4f57-a137-3d41d76db281 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:08.700471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab289f-77d2-4f57-a137-3d41d76db281 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:08.733992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34586b03-7f30-4dd7-9958-9c78bde8bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:08.734856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586b03-7f30-4dd7-9958-9c78bde8bffe None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:08.735137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586b03-7f30-4dd7-9958-9c78bde8bffe None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:08.735411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586b03-7f30-4dd7-9958-9c78bde8bffe None admin] PATH_INFO: `/v3/users/0c75c4a291424cb79ab28fcd56ff7d63` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:08.737577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34586b03-7f30-4dd7-9958-9c78bde8bffe None admin] RBAC: Authorizing `identity:get_user(user_id=0c75c4a291424cb79ab28fcd56ff7d63)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:08.739040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34586b03-7f30-4dd7-9958-9c78bde8bffe None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:08.740662 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 560/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:08 2022] GET /identity/v3/users/0c75c4a291424cb79ab28fcd56ff7d63 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:08.746508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e4394-2cb9-4752-b7d1-7c63cd46541e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:08.844118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e4394-2cb9-4752-b7d1-7c63cd46541e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:08.878744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5376f-9036-4414-965a-3d67039455c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:08.879313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5376f-9036-4414-965a-3d67039455c3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:08.879597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5376f-9036-4414-965a-3d67039455c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:08.879872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5376f-9036-4414-965a-3d67039455c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:08.945144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5376f-9036-4414-965a-3d67039455c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:08.946609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5376f-9036-4414-965a-3d67039455c3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:09.041502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 568/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:43:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:43:09.047350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34586b03-7f30-4dd7-9958-9c78bde8bffe None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:09.144462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34586b03-7f30-4dd7-9958-9c78bde8bffe None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:09.177720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198de1-8f60-439a-8924-b308935304be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:09.178571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198de1-8f60-439a-8924-b308935304be None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:09.178848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198de1-8f60-439a-8924-b308935304be None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:09.179122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198de1-8f60-439a-8924-b308935304be None admin] PATH_INFO: `/v3/projects/90e071137a6940928001b7de44b93289` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:09.180303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198de1-8f60-439a-8924-b308935304be None admin] RBAC: Authorizing `identity:get_project(project_id=90e071137a6940928001b7de44b93289)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:09.181766 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198de1-8f60-439a-8924-b308935304be None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:09.183453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 561/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:09 2022] GET /identity/v3/projects/90e071137a6940928001b7de44b93289 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:09.189958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5376f-9036-4414-965a-3d67039455c3 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:09.287280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5376f-9036-4414-965a-3d67039455c3 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:09.320993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc8f33-1d7a-42b0-8524-4dc988c567f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:09.321657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8f33-1d7a-42b0-8524-4dc988c567f3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:09.321940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8f33-1d7a-42b0-8524-4dc988c567f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:09.322217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc8f33-1d7a-42b0-8524-4dc988c567f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:09.323074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc8f33-1d7a-42b0-8524-4dc988c567f3 None admin] RBAC: Adding query filter params (role.id=597c56383ca9464ca3bf4ae47dbf7716, scope.project.id=90e071137a6940928001b7de44b93289, user.id=0c75c4a291424cb79ab28fcd56ff7d63) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:09.323383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc8f33-1d7a-42b0-8524-4dc988c567f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:09.324803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc8f33-1d7a-42b0-8524-4dc988c567f3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:09.330661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 569/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:43:09 2022] GET /identity/v3/role_assignments?user.id=0c75c4a291424cb79ab28fcd56ff7d63&scope.project.id=90e071137a6940928001b7de44b93289&role.id=597c56383ca9464ca3bf4ae47dbf7716 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:43:11.626879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c639-d0e1-46b8-a2b5-8d4d45d82ec4 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:11.627436 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c639-d0e1-46b8-a2b5-8d4d45d82ec4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:11.627652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c639-d0e1-46b8-a2b5-8d4d45d82ec4 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:11.629049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 562/1131] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:11.634339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29043-69a8-4886-b6cf-f08727d1ad42 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:11.638980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29043-69a8-4886-b6cf-f08727d1ad42 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:11.638980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29043-69a8-4886-b6cf-f08727d1ad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:11.652481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-91c29043-69a8-4886-b6cf-f08727d1ad42 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:11.653683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-91c29043-69a8-4886-b6cf-f08727d1ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:11.717851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 570/1132] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:11.742253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569c639-d0e1-46b8-a2b5-8d4d45d82ec4 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:11.839762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569c639-d0e1-46b8-a2b5-8d4d45d82ec4 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:11.872462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1c2a9-cae8-4193-9dfe-de94c14b1484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:11.873265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c2a9-cae8-4193-9dfe-de94c14b1484 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:11.873543 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c2a9-cae8-4193-9dfe-de94c14b1484 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:11.873811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c2a9-cae8-4193-9dfe-de94c14b1484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:11.874972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1c2a9-cae8-4193-9dfe-de94c14b1484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:11.876418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1c2a9-cae8-4193-9dfe-de94c14b1484 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:11.878105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 563/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:11.883934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c29043-69a8-4886-b6cf-f08727d1ad42 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:11.980253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c29043-69a8-4886-b6cf-f08727d1ad42 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:12.012412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17af8c9-f1d7-4296-af98-a497c53c0517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:12.013068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af8c9-f1d7-4296-af98-a497c53c0517 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:12.013379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af8c9-f1d7-4296-af98-a497c53c0517 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:12.013656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17af8c9-f1d7-4296-af98-a497c53c0517 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:12.014367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17af8c9-f1d7-4296-af98-a497c53c0517 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:12.015818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17af8c9-f1d7-4296-af98-a497c53c0517 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:12.115461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 571/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:43:11 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:43:14.376829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539849-885a-4447-8e44-77b7aedec254 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:14.377394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539849-885a-4447-8e44-77b7aedec254 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:14.377394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539849-885a-4447-8e44-77b7aedec254 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:14.378788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 564/1135] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:14.383910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15259d-dd7d-443d-a032-fe5721abd786 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:14.384337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15259d-dd7d-443d-a032-fe5721abd786 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:14.384474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15259d-dd7d-443d-a032-fe5721abd786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:14.402178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-cf15259d-dd7d-443d-a032-fe5721abd786 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:14.403356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-cf15259d-dd7d-443d-a032-fe5721abd786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:14.467581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 572/1136] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:14.492559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd539849-885a-4447-8e44-77b7aedec254 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:14.591971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd539849-885a-4447-8e44-77b7aedec254 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:14.624039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f13430-2f69-41ac-97da-d4ff71b02f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:14.624825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f13430-2f69-41ac-97da-d4ff71b02f77 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:14.625097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f13430-2f69-41ac-97da-d4ff71b02f77 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:14.625400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f13430-2f69-41ac-97da-d4ff71b02f77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:14.627182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f13430-2f69-41ac-97da-d4ff71b02f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:14.628540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f13430-2f69-41ac-97da-d4ff71b02f77 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:14.630180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 565/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:43:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:14.635952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15259d-dd7d-443d-a032-fe5721abd786 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:14.730065 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15259d-dd7d-443d-a032-fe5721abd786 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:14.764211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31acdc-2afe-402e-a8a7-2686392c618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:14.764918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31acdc-2afe-402e-a8a7-2686392c618b None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:14.765204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31acdc-2afe-402e-a8a7-2686392c618b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:14.765508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31acdc-2afe-402e-a8a7-2686392c618b None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:14.766214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31acdc-2afe-402e-a8a7-2686392c618b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:14.767819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31acdc-2afe-402e-a8a7-2686392c618b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:14.881268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 573/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:43:14 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:43:17.155224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f359-36ab-494a-9a02-d456bd606479 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:17.155756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f359-36ab-494a-9a02-d456bd606479 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:17.155756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f359-36ab-494a-9a02-d456bd606479 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:17.157171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 566/1139] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:17.162814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70833-28bd-4e24-8f6f-db64521db5d5 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:17.163197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70833-28bd-4e24-8f6f-db64521db5d5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:17.163372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70833-28bd-4e24-8f6f-db64521db5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:17.179628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-99e70833-28bd-4e24-8f6f-db64521db5d5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:17.180791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-99e70833-28bd-4e24-8f6f-db64521db5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:17.244407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 574/1140] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:17.267849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f359-36ab-494a-9a02-d456bd606479 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:17.367696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f359-36ab-494a-9a02-d456bd606479 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:17.402695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ff520-229c-408b-b6b4-e8a17fc78619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:17.403489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff520-229c-408b-b6b4-e8a17fc78619 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:17.403770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff520-229c-408b-b6b4-e8a17fc78619 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:17.404255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ff520-229c-408b-b6b4-e8a17fc78619 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:17.415451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ff520-229c-408b-b6b4-e8a17fc78619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-2c6ff520-229c-408b-b6b4-e8a17fc78619 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:43:17.423783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:43:17.425204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:43:17.426159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 567/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:43:17.431172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70833-28bd-4e24-8f6f-db64521db5d5 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:17.526891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70833-28bd-4e24-8f6f-db64521db5d5 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:17.561152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:17.561849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:17.562135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:17.562414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:17.563163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:17.563526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:17.565033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:17.572895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 575/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:17.578846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ff520-229c-408b-b6b4-e8a17fc78619 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:17.683386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ff520-229c-408b-b6b4-e8a17fc78619 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:17.716303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200441f-6ab6-4181-b0c2-0b0598bfc2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:17.717167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200441f-6ab6-4181-b0c2-0b0598bfc2b4 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:17.717470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200441f-6ab6-4181-b0c2-0b0598bfc2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:17.717743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200441f-6ab6-4181-b0c2-0b0598bfc2b4 None admin] PATH_INFO: `/v3/users/eccfd72b2f954c018442d3b4e7e2cc78` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:17.732387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200441f-6ab6-4181-b0c2-0b0598bfc2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=eccfd72b2f954c018442d3b4e7e2cc78)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:17.733875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200441f-6ab6-4181-b0c2-0b0598bfc2b4 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:17.735730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 568/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:17 2022] GET /identity/v3/users/eccfd72b2f954c018442d3b4e7e2cc78 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:17.741593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:17.838353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c952f-0101-40dc-810f-d7d7ad365410 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:17.871249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fad33-4dd4-4037-b0f4-f5dec67d0ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:17.871891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fad33-4dd4-4037-b0f4-f5dec67d0ffb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:17.872178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fad33-4dd4-4037-b0f4-f5dec67d0ffb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:17.872458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fad33-4dd4-4037-b0f4-f5dec67d0ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:17.937626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fad33-4dd4-4037-b0f4-f5dec67d0ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:17.939161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fad33-4dd4-4037-b0f4-f5dec67d0ffb None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:18.034172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 576/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:43:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:43:18.040115 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200441f-6ab6-4181-b0c2-0b0598bfc2b4 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:18.137260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200441f-6ab6-4181-b0c2-0b0598bfc2b4 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:18.170504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc59f06-2010-4121-a35f-718395296f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:18.171357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc59f06-2010-4121-a35f-718395296f44 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:18.171641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc59f06-2010-4121-a35f-718395296f44 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:18.171919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc59f06-2010-4121-a35f-718395296f44 None admin] PATH_INFO: `/v3/projects/4e282213717e43a88a9edd67c690bfd9` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:18.173813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc59f06-2010-4121-a35f-718395296f44 None admin] RBAC: Authorizing `identity:get_project(project_id=4e282213717e43a88a9edd67c690bfd9)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:18.175243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc59f06-2010-4121-a35f-718395296f44 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:18.176944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 569/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:18 2022] GET /identity/v3/projects/4e282213717e43a88a9edd67c690bfd9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:18.183222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fad33-4dd4-4037-b0f4-f5dec67d0ffb None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:18.278983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fad33-4dd4-4037-b0f4-f5dec67d0ffb None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:18.312580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a9286-800b-46f3-99c7-d298b9e9c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:18.313228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a9286-800b-46f3-99c7-d298b9e9c797 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:18.313570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a9286-800b-46f3-99c7-d298b9e9c797 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:18.313851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a9286-800b-46f3-99c7-d298b9e9c797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:18.314683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a9286-800b-46f3-99c7-d298b9e9c797 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=4e282213717e43a88a9edd67c690bfd9, user.id=eccfd72b2f954c018442d3b4e7e2cc78) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:18.314994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a9286-800b-46f3-99c7-d298b9e9c797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:18.316461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a9286-800b-46f3-99c7-d298b9e9c797 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:18.321912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 577/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:43:18 2022] GET /identity/v3/role_assignments?user.id=eccfd72b2f954c018442d3b4e7e2cc78&scope.project.id=4e282213717e43a88a9edd67c690bfd9&role.id=f1d6bdc882c24a2a9389961135865317 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:20.659952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede72e5-fc14-47c4-b99e-86b56d437726 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:20.660496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede72e5-fc14-47c4-b99e-86b56d437726 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:20.660496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede72e5-fc14-47c4-b99e-86b56d437726 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:20.661902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 570/1147] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:20.667573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8501b-dc96-404a-b990-608b86c72866 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:20.668045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8501b-dc96-404a-b990-608b86c72866 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:20.668155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8501b-dc96-404a-b990-608b86c72866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:20.686458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-76e8501b-dc96-404a-b990-608b86c72866 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:20.687670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-76e8501b-dc96-404a-b990-608b86c72866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:20.753046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 578/1148] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:20.776048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede72e5-fc14-47c4-b99e-86b56d437726 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:20.880974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede72e5-fc14-47c4-b99e-86b56d437726 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:20.914612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b7d58-21ba-46d0-b67b-3fb349db2923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:20.915320 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b7d58-21ba-46d0-b67b-3fb349db2923 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:20.915599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b7d58-21ba-46d0-b67b-3fb349db2923 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:20.915875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b7d58-21ba-46d0-b67b-3fb349db2923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:20.926004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b7d58-21ba-46d0-b67b-3fb349db2923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-841b7d58-21ba-46d0-b67b-3fb349db2923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:43:20.933485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:43:20.934574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:43:20.935608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 571/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:43:20.940884 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8501b-dc96-404a-b990-608b86c72866 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:21.034991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8501b-dc96-404a-b990-608b86c72866 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:21.066449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:21.067783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:21.067783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:21.067783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:21.068360 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:21.068662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:21.070059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:21.077887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 579/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:21.084425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b7d58-21ba-46d0-b67b-3fb349db2923 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:21.181044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b7d58-21ba-46d0-b67b-3fb349db2923 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:21.213897 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b11b8-0a87-44e0-a5b0-5435f9508c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:21.214761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b11b8-0a87-44e0-a5b0-5435f9508c3a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:21.215043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b11b8-0a87-44e0-a5b0-5435f9508c3a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:21.215316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b11b8-0a87-44e0-a5b0-5435f9508c3a None admin] PATH_INFO: `/v3/users/eccfd72b2f954c018442d3b4e7e2cc78` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:21.216499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b11b8-0a87-44e0-a5b0-5435f9508c3a None admin] RBAC: Authorizing `identity:get_user(user_id=eccfd72b2f954c018442d3b4e7e2cc78)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:21.217954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b11b8-0a87-44e0-a5b0-5435f9508c3a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:21.219626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 572/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:21 2022] GET /identity/v3/users/eccfd72b2f954c018442d3b4e7e2cc78 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:21.226054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:21.324496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa2040-2009-4b38-b20f-d1cd6bda56fe None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:21.357802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b390f-9b44-498d-9e36-d323a43a91a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:21.358658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b390f-9b44-498d-9e36-d323a43a91a3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:21.358938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b390f-9b44-498d-9e36-d323a43a91a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:21.359215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b390f-9b44-498d-9e36-d323a43a91a3 None admin] PATH_INFO: `/v3/projects/4e282213717e43a88a9edd67c690bfd9` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:21.361465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b390f-9b44-498d-9e36-d323a43a91a3 None admin] RBAC: Authorizing `identity:get_project(project_id=4e282213717e43a88a9edd67c690bfd9)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:21.362980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b390f-9b44-498d-9e36-d323a43a91a3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:21.364676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 580/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:21 2022] GET /identity/v3/projects/4e282213717e43a88a9edd67c690bfd9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:21.370820 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b11b8-0a87-44e0-a5b0-5435f9508c3a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:21.467778 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b11b8-0a87-44e0-a5b0-5435f9508c3a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:21.500219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d451a-5b12-4b5a-9d15-279f430a8db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:21.501647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d451a-5b12-4b5a-9d15-279f430a8db5 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:21.501927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d451a-5b12-4b5a-9d15-279f430a8db5 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:21.502197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d451a-5b12-4b5a-9d15-279f430a8db5 None admin] PATH_INFO: `/v3/projects/4e282213717e43a88a9edd67c690bfd9/users/eccfd72b2f954c018442d3b4e7e2cc78/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:21.504136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d451a-5b12-4b5a-9d15-279f430a8db5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e282213717e43a88a9edd67c690bfd9, user_id=eccfd72b2f954c018442d3b4e7e2cc78, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:21.505618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d451a-5b12-4b5a-9d15-279f430a8db5 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:21.617721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 573/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:43:21 2022] PUT /identity/v3/projects/4e282213717e43a88a9edd67c690bfd9/users/eccfd72b2f954c018442d3b4e7e2cc78/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:43:23.836566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899503-f0a6-41fc-8516-dbfb5534cc74 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:23.837080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899503-f0a6-41fc-8516-dbfb5534cc74 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:23.837190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899503-f0a6-41fc-8516-dbfb5534cc74 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:23.838519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 581/1154] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:23.843590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29f001-94c2-49c6-8e4c-7cca45f67972 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:23.843980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29f001-94c2-49c6-8e4c-7cca45f67972 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:23.844144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29f001-94c2-49c6-8e4c-7cca45f67972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:23.861361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ac29f001-94c2-49c6-8e4c-7cca45f67972 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:23.862535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ac29f001-94c2-49c6-8e4c-7cca45f67972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:23.927316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 574/1155] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:23.950078 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899503-f0a6-41fc-8516-dbfb5534cc74 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:24.047204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899503-f0a6-41fc-8516-dbfb5534cc74 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:24.078621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5fe5-ca80-4125-af90-403fcad32a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:24.080003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5fe5-ca80-4125-af90-403fcad32a90 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:24.080275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5fe5-ca80-4125-af90-403fcad32a90 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:24.080543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5fe5-ca80-4125-af90-403fcad32a90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:24.090541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5fe5-ca80-4125-af90-403fcad32a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-adca5fe5-ca80-4125-af90-403fcad32a90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:43:24.098037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:43:24.099157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:43:24.100365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 582/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:43:24.105289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29f001-94c2-49c6-8e4c-7cca45f67972 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:24.200232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29f001-94c2-49c6-8e4c-7cca45f67972 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:24.233582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:24.234243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:24.234523 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:24.234797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:24.235573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:24.235883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:24.237271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:24.245153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 575/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:24.251596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5fe5-ca80-4125-af90-403fcad32a90 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:24.348396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5fe5-ca80-4125-af90-403fcad32a90 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:24.380376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d2ec-8cea-4170-b5e0-695fad8312a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:24.381225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d2ec-8cea-4170-b5e0-695fad8312a7 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:24.381531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d2ec-8cea-4170-b5e0-695fad8312a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:24.381800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d2ec-8cea-4170-b5e0-695fad8312a7 None admin] PATH_INFO: `/v3/users/eccfd72b2f954c018442d3b4e7e2cc78` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:24.382963 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308d2ec-8cea-4170-b5e0-695fad8312a7 None admin] RBAC: Authorizing `identity:get_user(user_id=eccfd72b2f954c018442d3b4e7e2cc78)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:24.384377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308d2ec-8cea-4170-b5e0-695fad8312a7 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:24.386014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 583/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:24 2022] GET /identity/v3/users/eccfd72b2f954c018442d3b4e7e2cc78 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:24.392803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:24.493633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6941c-6312-40e2-910c-5fb45f0b03d7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:24.526403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217172-87ea-4555-8717-8fb67f218269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:24.527075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217172-87ea-4555-8717-8fb67f218269 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:24.527363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217172-87ea-4555-8717-8fb67f218269 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:24.527645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217172-87ea-4555-8717-8fb67f218269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:24.591355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79217172-87ea-4555-8717-8fb67f218269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:24.592806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79217172-87ea-4555-8717-8fb67f218269 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:24.687605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 576/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:43:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:43:24.694060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d2ec-8cea-4170-b5e0-695fad8312a7 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:24.790141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d2ec-8cea-4170-b5e0-695fad8312a7 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:24.823488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d86e0-4ece-42f1-83d6-e39c1ad06dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:24.824343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d86e0-4ece-42f1-83d6-e39c1ad06dd2 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:24.824628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d86e0-4ece-42f1-83d6-e39c1ad06dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:24.824905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d86e0-4ece-42f1-83d6-e39c1ad06dd2 None admin] PATH_INFO: `/v3/projects/4e282213717e43a88a9edd67c690bfd9` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:24.826112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d86e0-4ece-42f1-83d6-e39c1ad06dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=4e282213717e43a88a9edd67c690bfd9)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:24.827565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d86e0-4ece-42f1-83d6-e39c1ad06dd2 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:24.829446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 584/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:24 2022] GET /identity/v3/projects/4e282213717e43a88a9edd67c690bfd9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:24.835731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217172-87ea-4555-8717-8fb67f218269 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:24.930073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217172-87ea-4555-8717-8fb67f218269 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:24.961863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004bd46-48d4-4e1c-9d3c-2efd10c32ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:24.962432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004bd46-48d4-4e1c-9d3c-2efd10c32ad8 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:24.962710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004bd46-48d4-4e1c-9d3c-2efd10c32ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:24.962980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004bd46-48d4-4e1c-9d3c-2efd10c32ad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:24.963795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004bd46-48d4-4e1c-9d3c-2efd10c32ad8 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=4e282213717e43a88a9edd67c690bfd9, user.id=eccfd72b2f954c018442d3b4e7e2cc78) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:24.964099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004bd46-48d4-4e1c-9d3c-2efd10c32ad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:24.965541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004bd46-48d4-4e1c-9d3c-2efd10c32ad8 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:24.971665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 577/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:43:24 2022] GET /identity/v3/role_assignments?user.id=eccfd72b2f954c018442d3b4e7e2cc78&scope.project.id=4e282213717e43a88a9edd67c690bfd9&role.id=f1d6bdc882c24a2a9389961135865317 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:27.270348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab6dc-c106-4bcc-bda8-56ab037d6293 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:27.270893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab6dc-c106-4bcc-bda8-56ab037d6293 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:27.270893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab6dc-c106-4bcc-bda8-56ab037d6293 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:27.272271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 585/1162] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:27.277461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccf1d-5345-421f-a3c6-ad2a6f66d390 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:27.277847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccf1d-5345-421f-a3c6-ad2a6f66d390 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:27.278027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ccf1d-5345-421f-a3c6-ad2a6f66d390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:27.295124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-967ccf1d-5345-421f-a3c6-ad2a6f66d390 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:27.296341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-967ccf1d-5345-421f-a3c6-ad2a6f66d390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:27.362362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 578/1163] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:27.384981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab6dc-c106-4bcc-bda8-56ab037d6293 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:27.483897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab6dc-c106-4bcc-bda8-56ab037d6293 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:27.516068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f85f-5582-48fa-bfec-cf504c13393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:27.517335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f85f-5582-48fa-bfec-cf504c13393b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:27.517621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f85f-5582-48fa-bfec-cf504c13393b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:27.517896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f85f-5582-48fa-bfec-cf504c13393b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:27.582110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604f85f-5582-48fa-bfec-cf504c13393b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:27.583478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604f85f-5582-48fa-bfec-cf504c13393b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:27.676542 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 586/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:43:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:43:27.682583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccf1d-5345-421f-a3c6-ad2a6f66d390 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:27.778727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ccf1d-5345-421f-a3c6-ad2a6f66d390 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:27.811647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1127aa-81ff-4071-af79-23ec079e927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:27.812437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1127aa-81ff-4071-af79-23ec079e927c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:27.812718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1127aa-81ff-4071-af79-23ec079e927c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:27.812993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1127aa-81ff-4071-af79-23ec079e927c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:27.819833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1127aa-81ff-4071-af79-23ec079e927c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:27.821297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1127aa-81ff-4071-af79-23ec079e927c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-ee1127aa-81ff-4071-af79-23ec079e927c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:43:27.835585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:43:27.836848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:43:27.837972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 579/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:43:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:43:27.842765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f85f-5582-48fa-bfec-cf504c13393b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:27.935981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f85f-5582-48fa-bfec-cf504c13393b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:27.968218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8349ee-31c7-4d6f-bbf5-5e9a1133992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:27.968864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8349ee-31c7-4d6f-bbf5-5e9a1133992e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:27.969147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8349ee-31c7-4d6f-bbf5-5e9a1133992e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:27.970080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8349ee-31c7-4d6f-bbf5-5e9a1133992e None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:27.970811 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8349ee-31c7-4d6f-bbf5-5e9a1133992e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:27.979802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8349ee-31c7-4d6f-bbf5-5e9a1133992e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:27.979802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8349ee-31c7-4d6f-bbf5-5e9a1133992e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:27.979802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 587/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Wed May 4 13:43:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:30.239841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaeef-c34e-4e4f-87df-42aaeb9fa2ec None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:30.240435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaeef-c34e-4e4f-87df-42aaeb9fa2ec None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:30.240435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaeef-c34e-4e4f-87df-42aaeb9fa2ec None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:30.241807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 580/1167] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:30.247498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778d00d-34bd-40f1-9cf8-83b40c4d6e2c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:30.247901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778d00d-34bd-40f1-9cf8-83b40c4d6e2c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:30.248068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778d00d-34bd-40f1-9cf8-83b40c4d6e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:30.264919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0778d00d-34bd-40f1-9cf8-83b40c4d6e2c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:30.266147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0778d00d-34bd-40f1-9cf8-83b40c4d6e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:30.332128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 588/1168] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:30.355504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eaeef-c34e-4e4f-87df-42aaeb9fa2ec None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:30.461613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eaeef-c34e-4e4f-87df-42aaeb9fa2ec None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:30.495398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644256d-5176-4bea-a238-d5d4c9522617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:30.495988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644256d-5176-4bea-a238-d5d4c9522617 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:30.496348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644256d-5176-4bea-a238-d5d4c9522617 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:30.496636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644256d-5176-4bea-a238-d5d4c9522617 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:30.497408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644256d-5176-4bea-a238-d5d4c9522617 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:30.498769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644256d-5176-4bea-a238-d5d4c9522617 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:30.577992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 581/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Wed May 4 13:43:30 2022] POST /identity/v3/domains => generated 267 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:43:32.918493 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719a46a-0cd8-46dd-acae-76714ceb6a88 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:32.919055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719a46a-0cd8-46dd-acae-76714ceb6a88 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:32.919055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719a46a-0cd8-46dd-acae-76714ceb6a88 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:32.920471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 589/1170] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:32.926397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757246-059e-43ed-8673-7dccb8741a6d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:32.926886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757246-059e-43ed-8673-7dccb8741a6d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:32.926995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757246-059e-43ed-8673-7dccb8741a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:32.945159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-91757246-059e-43ed-8673-7dccb8741a6d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:32.946376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-91757246-059e-43ed-8673-7dccb8741a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:33.014882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 582/1171] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:33.039860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719a46a-0cd8-46dd-acae-76714ceb6a88 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:33.140680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719a46a-0cd8-46dd-acae-76714ceb6a88 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:33.177691 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa425c3-b7c9-43de-8ae2-489b5f0133d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:33.178575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa425c3-b7c9-43de-8ae2-489b5f0133d0 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:33.178855 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa425c3-b7c9-43de-8ae2-489b5f0133d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:33.179132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa425c3-b7c9-43de-8ae2-489b5f0133d0 None admin] PATH_INFO: `/v3/domains/5b4bb6952de64de486893d69ac66d58b` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:33.192002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa425c3-b7c9-43de-8ae2-489b5f0133d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5b4bb6952de64de486893d69ac66d58b)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:33.193528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa425c3-b7c9-43de-8ae2-489b5f0133d0 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:33.195437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 590/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Wed May 4 13:43:33 2022] GET /identity/v3/domains/5b4bb6952de64de486893d69ac66d58b => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:33.201676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757246-059e-43ed-8673-7dccb8741a6d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:33.367475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757246-059e-43ed-8673-7dccb8741a6d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:33.405620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc4f5c-79a7-4b96-ac3e-163c26c71eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:33.406293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc4f5c-79a7-4b96-ac3e-163c26c71eff None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:33.406582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc4f5c-79a7-4b96-ac3e-163c26c71eff None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:33.406859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc4f5c-79a7-4b96-ac3e-163c26c71eff None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:33.407993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc4f5c-79a7-4b96-ac3e-163c26c71eff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:33.409513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc4f5c-79a7-4b96-ac3e-163c26c71eff None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:33.515932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 583/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:43:33 2022] POST /identity/v3/projects => generated 361 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:43:35.868285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6297fdc-05f7-4424-aea6-32d6ece3a044 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:35.868836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6297fdc-05f7-4424-aea6-32d6ece3a044 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:35.868836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6297fdc-05f7-4424-aea6-32d6ece3a044 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:35.870314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 591/1174] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:35.876209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10adfea-13ed-45e8-bc51-b5b36c9e7ba5 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:35.876818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10adfea-13ed-45e8-bc51-b5b36c9e7ba5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:35.876818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10adfea-13ed-45e8-bc51-b5b36c9e7ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:35.893521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d10adfea-13ed-45e8-bc51-b5b36c9e7ba5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:35.894708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d10adfea-13ed-45e8-bc51-b5b36c9e7ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:35.963240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 584/1175] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:35.988800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6297fdc-05f7-4424-aea6-32d6ece3a044 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:36.087448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6297fdc-05f7-4424-aea6-32d6ece3a044 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:36.121860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe218bbb-072e-45b8-a909-bcbc332e2963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:36.122708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe218bbb-072e-45b8-a909-bcbc332e2963 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:36.122992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe218bbb-072e-45b8-a909-bcbc332e2963 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:36.123277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe218bbb-072e-45b8-a909-bcbc332e2963 None admin] PATH_INFO: `/v3/domains/5b4bb6952de64de486893d69ac66d58b` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:36.124486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe218bbb-072e-45b8-a909-bcbc332e2963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5b4bb6952de64de486893d69ac66d58b)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:36.126013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe218bbb-072e-45b8-a909-bcbc332e2963 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:36.127612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 592/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Wed May 4 13:43:35 2022] GET /identity/v3/domains/5b4bb6952de64de486893d69ac66d58b => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:36.133604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10adfea-13ed-45e8-bc51-b5b36c9e7ba5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:36.228445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10adfea-13ed-45e8-bc51-b5b36c9e7ba5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:36.262132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2393f49-b8de-4db0-ad38-8b3a1cf3b975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:36.262809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2393f49-b8de-4db0-ad38-8b3a1cf3b975 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:36.263112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2393f49-b8de-4db0-ad38-8b3a1cf3b975 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:36.263370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2393f49-b8de-4db0-ad38-8b3a1cf3b975 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:36.264084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2393f49-b8de-4db0-ad38-8b3a1cf3b975 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:36.265554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2393f49-b8de-4db0-ad38-8b3a1cf3b975 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:36.389140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 585/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:43:36 2022] POST /identity/v3/users => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:43:38.736345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ba41-721f-43a7-8180-681d24f326e1 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:38.736916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ba41-721f-43a7-8180-681d24f326e1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:38.736916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ba41-721f-43a7-8180-681d24f326e1 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:38.738488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 593/1178] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:38.743728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691faa-f372-4496-935e-82624f1fd203 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:38.744194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691faa-f372-4496-935e-82624f1fd203 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:38.744303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4691faa-f372-4496-935e-82624f1fd203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:38.761031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d4691faa-f372-4496-935e-82624f1fd203 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:38.762237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d4691faa-f372-4496-935e-82624f1fd203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:38.826699 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 586/1179] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:38.851349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2ba41-721f-43a7-8180-681d24f326e1 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:38.951324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2ba41-721f-43a7-8180-681d24f326e1 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:38.985739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d91884-57b3-4416-acec-643ed7424558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:38.986718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91884-57b3-4416-acec-643ed7424558 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:38.986944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91884-57b3-4416-acec-643ed7424558 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:38.987225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91884-57b3-4416-acec-643ed7424558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:38.997171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d91884-57b3-4416-acec-643ed7424558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e0d91884-57b3-4416-acec-643ed7424558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:43:39.005683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:43:39.006956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:43:39.008069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 594/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:43:39.013152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4691faa-f372-4496-935e-82624f1fd203 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:39.119143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4691faa-f372-4496-935e-82624f1fd203 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:39.153855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:39.154519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:39.154796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:39.155070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:39.155817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:39.156121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:39.158068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:39.166935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 587/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:39.173848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d91884-57b3-4416-acec-643ed7424558 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:39.279267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d91884-57b3-4416-acec-643ed7424558 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:39.314639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926276fe-6346-4bec-977e-4618827834da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:39.315505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926276fe-6346-4bec-977e-4618827834da None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:39.315784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926276fe-6346-4bec-977e-4618827834da None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:39.316058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926276fe-6346-4bec-977e-4618827834da None admin] PATH_INFO: `/v3/users/c1a7deecf0ac4161b19dfb62fdd22e1a` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:39.330135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926276fe-6346-4bec-977e-4618827834da None admin] RBAC: Authorizing `identity:get_user(user_id=c1a7deecf0ac4161b19dfb62fdd22e1a)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:39.331612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926276fe-6346-4bec-977e-4618827834da None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:39.333367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 595/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:39 2022] GET /identity/v3/users/c1a7deecf0ac4161b19dfb62fdd22e1a => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:39.339423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:39.439749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dd551-915b-497d-8e5b-c27ee91e1a70 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:39.473826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826c0e0-e32c-4c16-9d37-c84c567a98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:39.474490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c0e0-e32c-4c16-9d37-c84c567a98c5 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:39.474775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c0e0-e32c-4c16-9d37-c84c567a98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:39.475052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c0e0-e32c-4c16-9d37-c84c567a98c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:39.542776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826c0e0-e32c-4c16-9d37-c84c567a98c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:39.544167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826c0e0-e32c-4c16-9d37-c84c567a98c5 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:39.647827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 588/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:43:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:43:39.653856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926276fe-6346-4bec-977e-4618827834da None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:39.771804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926276fe-6346-4bec-977e-4618827834da None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:39.812157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada0c88-80b6-4b97-a315-4dca686a3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:39.812997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0c88-80b6-4b97-a315-4dca686a3f34 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:39.813324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0c88-80b6-4b97-a315-4dca686a3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:39.813600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0c88-80b6-4b97-a315-4dca686a3f34 None admin] PATH_INFO: `/v3/projects/1eb6ed2945334c778d2f117be1934d41` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:39.814813 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada0c88-80b6-4b97-a315-4dca686a3f34 None admin] RBAC: Authorizing `identity:get_project(project_id=1eb6ed2945334c778d2f117be1934d41)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:39.816245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada0c88-80b6-4b97-a315-4dca686a3f34 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:39.823080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 596/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:39 2022] GET /identity/v3/projects/1eb6ed2945334c778d2f117be1934d41 => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:39.824269 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826c0e0-e32c-4c16-9d37-c84c567a98c5 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:39.928576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826c0e0-e32c-4c16-9d37-c84c567a98c5 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:39.964708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f98e20-16e4-4aef-9756-fa7b07f0be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:39.965401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f98e20-16e4-4aef-9756-fa7b07f0be21 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:39.965686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f98e20-16e4-4aef-9756-fa7b07f0be21 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:39.965966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f98e20-16e4-4aef-9756-fa7b07f0be21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:39.966805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f98e20-16e4-4aef-9756-fa7b07f0be21 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=1eb6ed2945334c778d2f117be1934d41, user.id=c1a7deecf0ac4161b19dfb62fdd22e1a) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:39.967122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f98e20-16e4-4aef-9756-fa7b07f0be21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:39.968613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f98e20-16e4-4aef-9756-fa7b07f0be21 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:39.974817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 589/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:43:39 2022] GET /identity/v3/role_assignments?user.id=c1a7deecf0ac4161b19dfb62fdd22e1a&scope.project.id=1eb6ed2945334c778d2f117be1934d41&role.id=f1d6bdc882c24a2a9389961135865317 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:42.244195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3fd9-010a-4bce-874c-77317a05b7f0 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:42.244764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3fd9-010a-4bce-874c-77317a05b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:42.244764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3fd9-010a-4bce-874c-77317a05b7f0 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:42.246149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 597/1186] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:42.252271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780e02-3411-45d3-9be6-d7e6cecacc3e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:42.252925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780e02-3411-45d3-9be6-d7e6cecacc3e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:42.252925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780e02-3411-45d3-9be6-d7e6cecacc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:42.270519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1d780e02-3411-45d3-9be6-d7e6cecacc3e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:42.271713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1d780e02-3411-45d3-9be6-d7e6cecacc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:42.341222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 590/1187] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:43:42.365189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3fd9-010a-4bce-874c-77317a05b7f0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:42.465046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3fd9-010a-4bce-874c-77317a05b7f0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:42.499319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9d767-becc-4f24-a7ea-b9ce5bfe05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:42.500019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9d767-becc-4f24-a7ea-b9ce5bfe05b3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:42.500342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9d767-becc-4f24-a7ea-b9ce5bfe05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:42.500624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9d767-becc-4f24-a7ea-b9ce5bfe05b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:42.510908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9d767-becc-4f24-a7ea-b9ce5bfe05b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-7ab9d767-becc-4f24-a7ea-b9ce5bfe05b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:43:42.519234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:43:42.520411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:43:42.521556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 598/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:43:42.526656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d780e02-3411-45d3-9be6-d7e6cecacc3e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:42.628188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d780e02-3411-45d3-9be6-d7e6cecacc3e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:42.664274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:42.664939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:42.665221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:42.665521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:42.666273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:42.666579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:42.667956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:42.677200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 591/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:42.683204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9d767-becc-4f24-a7ea-b9ce5bfe05b3 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:42.781790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9d767-becc-4f24-a7ea-b9ce5bfe05b3 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:42.814281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0296e-ab5e-4d7b-9bce-95db90afacd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:42.815134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0296e-ab5e-4d7b-9bce-95db90afacd8 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:42.815412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0296e-ab5e-4d7b-9bce-95db90afacd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:42.815682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0296e-ab5e-4d7b-9bce-95db90afacd8 None admin] PATH_INFO: `/v3/users/c1a7deecf0ac4161b19dfb62fdd22e1a` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:42.816858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0296e-ab5e-4d7b-9bce-95db90afacd8 None admin] RBAC: Authorizing `identity:get_user(user_id=c1a7deecf0ac4161b19dfb62fdd22e1a)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:42.818295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0296e-ab5e-4d7b-9bce-95db90afacd8 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:42.819931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 599/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:42 2022] GET /identity/v3/users/c1a7deecf0ac4161b19dfb62fdd22e1a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:42.825835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:42.933935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfdf46-376c-47bb-91e0-4769bc71805d None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:42.968642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ed1b1-8e22-4a0d-8bf9-ad45c3f80a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:42.970146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ed1b1-8e22-4a0d-8bf9-ad45c3f80a2e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:42.970426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ed1b1-8e22-4a0d-8bf9-ad45c3f80a2e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:42.970691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ed1b1-8e22-4a0d-8bf9-ad45c3f80a2e None admin] PATH_INFO: `/v3/projects/1eb6ed2945334c778d2f117be1934d41` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:42.971930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ed1b1-8e22-4a0d-8bf9-ad45c3f80a2e None admin] RBAC: Authorizing `identity:get_project(project_id=1eb6ed2945334c778d2f117be1934d41)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:42.973410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ed1b1-8e22-4a0d-8bf9-ad45c3f80a2e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:42.975193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 592/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:42 2022] GET /identity/v3/projects/1eb6ed2945334c778d2f117be1934d41 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:42.981632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0296e-ab5e-4d7b-9bce-95db90afacd8 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:43.080534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0296e-ab5e-4d7b-9bce-95db90afacd8 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:43.113865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10614f1e-d48e-45a9-ae08-65027f94c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:43.114756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10614f1e-d48e-45a9-ae08-65027f94c3dd None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:43.115039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10614f1e-d48e-45a9-ae08-65027f94c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:43.115315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10614f1e-d48e-45a9-ae08-65027f94c3dd None admin] PATH_INFO: `/v3/projects/1eb6ed2945334c778d2f117be1934d41/users/c1a7deecf0ac4161b19dfb62fdd22e1a/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:43.117317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10614f1e-d48e-45a9-ae08-65027f94c3dd None admin] RBAC: Authorizing `identity:create_grant(project_id=1eb6ed2945334c778d2f117be1934d41, user_id=c1a7deecf0ac4161b19dfb62fdd22e1a, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:43.118818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10614f1e-d48e-45a9-ae08-65027f94c3dd None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:43.200228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 600/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:43:42 2022] PUT /identity/v3/projects/1eb6ed2945334c778d2f117be1934d41/users/c1a7deecf0ac4161b19dfb62fdd22e1a/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:43:45.511788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2919-0210-4dd7-9944-4aaaa4237dc1 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:45.512323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2919-0210-4dd7-9944-4aaaa4237dc1 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:45.512323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2919-0210-4dd7-9944-4aaaa4237dc1 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:45.513762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 593/1193] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:45.519544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfabcb2-cda9-4615-a553-4afdc7ca797e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:45.520009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfabcb2-cda9-4615-a553-4afdc7ca797e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:45.520107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfabcb2-cda9-4615-a553-4afdc7ca797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:45.536921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4cfabcb2-cda9-4615-a553-4afdc7ca797e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:45.538143 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4cfabcb2-cda9-4615-a553-4afdc7ca797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:45.605375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 601/1194] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:43:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:43:45.630537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc2919-0210-4dd7-9944-4aaaa4237dc1 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:45.733043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc2919-0210-4dd7-9944-4aaaa4237dc1 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:45.769917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fff6-0ffb-42c2-9505-ce307a005612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:45.770652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fff6-0ffb-42c2-9505-ce307a005612 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:45.770933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fff6-0ffb-42c2-9505-ce307a005612 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:45.771205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fff6-0ffb-42c2-9505-ce307a005612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:45.781746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5fff6-0ffb-42c2-9505-ce307a005612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-4ec5fff6-0ffb-42c2-9505-ce307a005612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:43:45.789489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:43:45.791253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:43:45.792854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 594/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:43:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:43:45.797560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfabcb2-cda9-4615-a553-4afdc7ca797e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:45.895389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfabcb2-cda9-4615-a553-4afdc7ca797e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:45.930205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:45.930909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:45.931195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:45.931472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:45.932285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:45.932540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:45.933956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:45.943421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 602/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:45.949522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fff6-0ffb-42c2-9505-ce307a005612 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:46.049715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fff6-0ffb-42c2-9505-ce307a005612 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:46.084149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ea6a7-d4fd-4b21-af1f-7c64d90bc39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:46.085018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ea6a7-d4fd-4b21-af1f-7c64d90bc39a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:46.085325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ea6a7-d4fd-4b21-af1f-7c64d90bc39a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:46.085599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ea6a7-d4fd-4b21-af1f-7c64d90bc39a None admin] PATH_INFO: `/v3/users/c1a7deecf0ac4161b19dfb62fdd22e1a` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:46.086944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ea6a7-d4fd-4b21-af1f-7c64d90bc39a None admin] RBAC: Authorizing `identity:get_user(user_id=c1a7deecf0ac4161b19dfb62fdd22e1a)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:46.088364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ea6a7-d4fd-4b21-af1f-7c64d90bc39a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:46.090036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 595/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Wed May 4 13:43:45 2022] GET /identity/v3/users/c1a7deecf0ac4161b19dfb62fdd22e1a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:46.096460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:46.194729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68646-b765-4a6f-860f-ca30ffe72014 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:46.228927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a448311-69e4-4a3f-85b3-6208f7c81ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:46.229604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448311-69e4-4a3f-85b3-6208f7c81ea1 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:46.229911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448311-69e4-4a3f-85b3-6208f7c81ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:46.230184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a448311-69e4-4a3f-85b3-6208f7c81ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:46.296517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a448311-69e4-4a3f-85b3-6208f7c81ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:46.298060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a448311-69e4-4a3f-85b3-6208f7c81ea1 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:46.396297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 603/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:43:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:43:46.402263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ea6a7-d4fd-4b21-af1f-7c64d90bc39a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:46.502111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ea6a7-d4fd-4b21-af1f-7c64d90bc39a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:46.535804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee28991-5068-4ace-9116-836f24a77917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:46.536668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28991-5068-4ace-9116-836f24a77917 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:46.536947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28991-5068-4ace-9116-836f24a77917 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:46.537225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee28991-5068-4ace-9116-836f24a77917 None admin] PATH_INFO: `/v3/projects/1eb6ed2945334c778d2f117be1934d41` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:46.538454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee28991-5068-4ace-9116-836f24a77917 None admin] RBAC: Authorizing `identity:get_project(project_id=1eb6ed2945334c778d2f117be1934d41)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:46.539890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee28991-5068-4ace-9116-836f24a77917 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:46.541710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 596/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Wed May 4 13:43:46 2022] GET /identity/v3/projects/1eb6ed2945334c778d2f117be1934d41 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:43:46.548669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a448311-69e4-4a3f-85b3-6208f7c81ea1 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:46.651417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a448311-69e4-4a3f-85b3-6208f7c81ea1 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:46.690577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c832e-b6f2-466c-9ef1-c17755fee47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:46.691224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c832e-b6f2-466c-9ef1-c17755fee47e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:46.691510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c832e-b6f2-466c-9ef1-c17755fee47e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:46.691790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c832e-b6f2-466c-9ef1-c17755fee47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:46.692698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c832e-b6f2-466c-9ef1-c17755fee47e None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=1eb6ed2945334c778d2f117be1934d41, user.id=c1a7deecf0ac4161b19dfb62fdd22e1a) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:43:46.693014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c832e-b6f2-466c-9ef1-c17755fee47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:46.694489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c832e-b6f2-466c-9ef1-c17755fee47e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:46.700593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 604/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:43:46 2022] GET /identity/v3/role_assignments?user.id=c1a7deecf0ac4161b19dfb62fdd22e1a&scope.project.id=1eb6ed2945334c778d2f117be1934d41&role.id=f1d6bdc882c24a2a9389961135865317 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:13.698829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd25c4-152f-427e-ab93-acaddd27fce0 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:13.699444 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd25c4-152f-427e-ab93-acaddd27fce0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:13.699444 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd25c4-152f-427e-ab93-acaddd27fce0 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:13.700987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 597/1201] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:13.706936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfe571-e157-494f-b3af-867374aabdc7 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:13.712448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfe571-e157-494f-b3af-867374aabdc7 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:13.712448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfe571-e157-494f-b3af-867374aabdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:13.724664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b7bfe571-e157-494f-b3af-867374aabdc7 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:13.725869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b7bfe571-e157-494f-b3af-867374aabdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:13.792276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 605/1202] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:13.816969 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd25c4-152f-427e-ab93-acaddd27fce0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:13.922229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd25c4-152f-427e-ab93-acaddd27fce0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:13.955701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:13.956416 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:13.956701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:13.956996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:13.967097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:13.969223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:13.987657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:13.988918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:13.990104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:13.990104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:13.990104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:13.990104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:13.990104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 598/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:13.995007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfe571-e157-494f-b3af-867374aabdc7 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:14.090943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfe571-e157-494f-b3af-867374aabdc7 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:14.124963 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa29754-6783-4b85-b8fb-7dd67b105a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:14.125723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29754-6783-4b85-b8fb-7dd67b105a4d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:14.126013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29754-6783-4b85-b8fb-7dd67b105a4d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:14.126290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa29754-6783-4b85-b8fb-7dd67b105a4d None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:14.127016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa29754-6783-4b85-b8fb-7dd67b105a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:14.127323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa29754-6783-4b85-b8fb-7dd67b105a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:14.128695 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa29754-6783-4b85-b8fb-7dd67b105a4d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:14.140294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 606/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:14.146051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:14.259104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b660a-a921-46f6-9a9c-a66e544fbe0e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:14.298770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916de95-04fb-480f-a3bf-3749d5083a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:14.299627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916de95-04fb-480f-a3bf-3749d5083a09 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:14.300008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916de95-04fb-480f-a3bf-3749d5083a09 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:14.300402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916de95-04fb-480f-a3bf-3749d5083a09 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:14.301384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916de95-04fb-480f-a3bf-3749d5083a09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:14.303296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916de95-04fb-480f-a3bf-3749d5083a09 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:14.526873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 599/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Wed May 4 13:45:14 2022] POST /identity/v3/users => generated 251 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:45:16.808290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1578d-e424-4a6d-a702-ead083a17b46 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:16.808853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1578d-e424-4a6d-a702-ead083a17b46 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:16.808853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1578d-e424-4a6d-a702-ead083a17b46 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:16.810240 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 607/1206] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:16.815561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a5744-e1ff-4bd3-a492-e22e363c6417 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:16.816226 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a5744-e1ff-4bd3-a492-e22e363c6417 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:16.816226 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a5744-e1ff-4bd3-a492-e22e363c6417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:16.832951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-910a5744-e1ff-4bd3-a492-e22e363c6417 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:16.834171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-910a5744-e1ff-4bd3-a492-e22e363c6417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:16.903382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 600/1207] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:16.927951 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1578d-e424-4a6d-a702-ead083a17b46 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:17.035244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1578d-e424-4a6d-a702-ead083a17b46 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:17.069494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c432f-9cec-49a3-b153-185bf69100b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:17.074034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c432f-9cec-49a3-b153-185bf69100b5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:17.074034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c432f-9cec-49a3-b153-185bf69100b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:17.074034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c432f-9cec-49a3-b153-185bf69100b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:17.081890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c432f-9cec-49a3-b153-185bf69100b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-270c432f-9cec-49a3-b153-185bf69100b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:45:17.089665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:17.090651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:17.091512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 608/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:17.097843 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a5744-e1ff-4bd3-a492-e22e363c6417 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:17.201343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a5744-e1ff-4bd3-a492-e22e363c6417 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:17.234818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:17.235575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:17.235854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:17.236130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:17.236877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:17.237182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:17.238574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:17.246350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 601/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:17.252810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c432f-9cec-49a3-b153-185bf69100b5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:17.349639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c432f-9cec-49a3-b153-185bf69100b5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:17.384121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:17.384905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:17.385190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:17.385492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:17.395942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:17.400215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:17.414404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:17.415482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:17.416598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:17.416598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:17.416598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:17.416598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:17.416598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 609/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:17.422445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:17.521182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dfb4a-46f7-437c-a980-50853451e842 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:17.554097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:17.554757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:17.555042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:17.555320 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:17.556039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:17.556385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:17.557746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:17.569966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 602/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:17.575698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:17.677056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8215-ba2c-4824-943d-0811e6d760e5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:17.711932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:17.712723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:17.713004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:17.713299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:17.720372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:17.721838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:45:17.737066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:17.738249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:17.739519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 610/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:17.744143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:17.842999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75723cc9-0e47-4c8d-b5fd-6ca20cc090cc None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:17.878798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:17.879463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:17.879746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:17.880022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:17.880859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:17.881279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:17.882705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:17.902335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 603/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 13:45:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:17.908969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:18.010101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0825696-2f74-4667-b38f-f3b95bea62ec None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:18.044142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dde12-fc72-443f-89aa-42334ed89fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:18.044789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dde12-fc72-443f-89aa-42334ed89fe0 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:18.045104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dde12-fc72-443f-89aa-42334ed89fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:18.045419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dde12-fc72-443f-89aa-42334ed89fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:18.111599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dde12-fc72-443f-89aa-42334ed89fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:18.113039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dde12-fc72-443f-89aa-42334ed89fe0 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:18.209796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 611/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:45:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:45:18.215633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:18.317288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94516c43-2dc1-4503-ba71-fe3a8105b446 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:18.350709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:18.351521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:18.351806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:18.352088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:18.362869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:18.364395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:18.381629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:18.383547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:18.385601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:18.385601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:18.385601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:18.385601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:18.385601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 604/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:18.388764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dde12-fc72-443f-89aa-42334ed89fe0 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:18.486983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dde12-fc72-443f-89aa-42334ed89fe0 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:18.519777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:18.520421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:18.520704 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:18.520984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:18.521736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:18.522045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:18.523390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:18.536520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 612/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:18.542449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:18.641086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22fd95-0527-42da-85b1-484d7df67d95 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:18.681847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:18.682829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:18.683243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:18.683549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:18.690711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:18.692147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:45:18.705634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:18.706554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:18.707469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 605/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:18.712852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:18.818328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d697-bb9e-42c3-9c9c-198d0e593127 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:18.852610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584b934-53a7-4303-9452-8bf8a4ee7909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:18.853274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584b934-53a7-4303-9452-8bf8a4ee7909 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:18.853557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584b934-53a7-4303-9452-8bf8a4ee7909 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:18.853828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584b934-53a7-4303-9452-8bf8a4ee7909 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:18.854609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584b934-53a7-4303-9452-8bf8a4ee7909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:18.854912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584b934-53a7-4303-9452-8bf8a4ee7909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:18.856532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584b934-53a7-4303-9452-8bf8a4ee7909 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:18.869387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 613/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:18.876409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:18.975889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933532b-237e-40b2-925c-bd345f2d7ae0 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:19.008915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ed11f-7978-4a8a-be75-fe107a06a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:19.009580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed11f-7978-4a8a-be75-fe107a06a1bd None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:19.011036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed11f-7978-4a8a-be75-fe107a06a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:19.011036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed11f-7978-4a8a-be75-fe107a06a1bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:19.011036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ed11f-7978-4a8a-be75-fe107a06a1bd None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=06ffd2170c2243eab4511fced8d67ab1) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:19.011317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ed11f-7978-4a8a-be75-fe107a06a1bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:19.012663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ed11f-7978-4a8a-be75-fe107a06a1bd None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:19.018823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 606/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:45:18 2022] GET /identity/v3/role_assignments?user.id=06ffd2170c2243eab4511fced8d67ab1&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:21.303719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f650-dbd6-4158-911b-4ecf4a6272aa None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:21.304282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f650-dbd6-4158-911b-4ecf4a6272aa None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:21.304282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f650-dbd6-4158-911b-4ecf4a6272aa None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:21.305749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 614/1220] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:21.311136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a864c7-7d44-4a8b-8917-2fbdeb24ec77 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:21.312102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a864c7-7d44-4a8b-8917-2fbdeb24ec77 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:21.312530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a864c7-7d44-4a8b-8917-2fbdeb24ec77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:21.330481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-66a864c7-7d44-4a8b-8917-2fbdeb24ec77 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:21.331668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-66a864c7-7d44-4a8b-8917-2fbdeb24ec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:21.409094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 607/1221] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:45:21.432367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921f650-dbd6-4158-911b-4ecf4a6272aa None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:21.543457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921f650-dbd6-4158-911b-4ecf4a6272aa None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:21.579694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02149-bf26-4f0d-841b-2fed2d4e02d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:21.580406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02149-bf26-4f0d-841b-2fed2d4e02d9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:21.580687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02149-bf26-4f0d-841b-2fed2d4e02d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:21.580960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02149-bf26-4f0d-841b-2fed2d4e02d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:21.591456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff02149-bf26-4f0d-841b-2fed2d4e02d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-7ff02149-bf26-4f0d-841b-2fed2d4e02d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:45:21.601196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:21.602348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:21.603387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 615/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:21.609165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a864c7-7d44-4a8b-8917-2fbdeb24ec77 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:21.715451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a864c7-7d44-4a8b-8917-2fbdeb24ec77 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:21.752038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:21.752718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:21.753463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:21.753746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:21.754509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:21.754818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:21.756239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:21.764867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 608/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:21.771213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02149-bf26-4f0d-841b-2fed2d4e02d9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:21.872534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02149-bf26-4f0d-841b-2fed2d4e02d9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:21.908751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:21.909569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:21.909909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:21.910186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:21.920573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:21.922510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:21.940392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:21.941553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:21.942546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:21.942546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:21.942546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:21.942546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:21.942546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 616/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:21.947390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:22.047854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc661e-5657-478b-8c92-ce79088926c7 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:22.081211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:22.081922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:22.082216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:22.082533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:22.083271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:22.083582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:22.084960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:22.097483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 609/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:22.103297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:22.210262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdaa2c-33ae-41d5-a952-47d1fca63f99 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:22.242823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:22.243669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:22.243957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:22.244231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:22.252655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:22.254131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:45:22.268561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:22.269736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:22.271042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 617/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:22.275774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:22.375257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161c25f-dee1-4a37-889e-aa020410464a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:22.408170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:22.408833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:22.409116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:22.409421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:22.410255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:22.410564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:22.411975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:22.429125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 610/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 13:45:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:22.434803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:22.532885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e4815-0e8d-435e-b8f3-6171b9b30298 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:22.566479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:22.567262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:22.567547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:22.567823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:22.578961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:22.594507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:22.598372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:22.599406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:22.604989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:22.604989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:22.604989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:22.604989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:22.604989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 618/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:22.607453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:22.710488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82762c0e-996d-4711-85f3-54bd1df199db None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:22.745353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:22.746082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:22.746368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:22.746645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:22.748504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:22.748504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:22.749317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:22.762474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 611/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:22.768546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:22.868298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15f96-618e-4f13-8c16-f4e99bdbaf1e None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:22.901914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:22.902703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:22.902984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:22.903257 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:22.910518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:22.911975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:45:22.926362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:22.927430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:22.928693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 619/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:22.933435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:23.031132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b91a-d839-46f6-a56d-60fd1ed79ecd None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:23.064511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc36b8-343b-4de0-ad9c-ad41a1e00366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:23.065174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc36b8-343b-4de0-ad9c-ad41a1e00366 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:23.065489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc36b8-343b-4de0-ad9c-ad41a1e00366 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:23.065770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc36b8-343b-4de0-ad9c-ad41a1e00366 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:23.066704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc36b8-343b-4de0-ad9c-ad41a1e00366 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:23.067020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc36b8-343b-4de0-ad9c-ad41a1e00366 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:23.068458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc36b8-343b-4de0-ad9c-ad41a1e00366 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:23.081748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 612/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:23.087740 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:23.185862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904d87-75da-4b15-a46a-d6cc01384673 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:23.219407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f46e2a-bccf-4689-8848-02bab6b02c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:23.220314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f46e2a-bccf-4689-8848-02bab6b02c87 None admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:23.220575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f46e2a-bccf-4689-8848-02bab6b02c87 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:23.220858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f46e2a-bccf-4689-8848-02bab6b02c87 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/06ffd2170c2243eab4511fced8d67ab1/roles/0827027c0db142779b191de9ce1ece80` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:23.235455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f46e2a-bccf-4689-8848-02bab6b02c87 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=06ffd2170c2243eab4511fced8d67ab1, role_id=0827027c0db142779b191de9ce1ece80)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:23.236363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f46e2a-bccf-4689-8848-02bab6b02c87 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:23.329336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 620/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:45:23 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/06ffd2170c2243eab4511fced8d67ab1/roles/0827027c0db142779b191de9ce1ece80 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:45:25.597659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343e27-698d-40c7-8a16-505488a6f932 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:25.598314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343e27-698d-40c7-8a16-505488a6f932 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:25.598314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343e27-698d-40c7-8a16-505488a6f932 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:25.599744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 613/1233] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:25.604819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6453-59ab-4658-ab90-1df0d58a425f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:25.605231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6453-59ab-4658-ab90-1df0d58a425f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:25.605442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6453-59ab-4658-ab90-1df0d58a425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:25.622430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3a9d6453-59ab-4658-ab90-1df0d58a425f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:25.623670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3a9d6453-59ab-4658-ab90-1df0d58a425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:25.691067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 621/1234] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:25.716463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343e27-698d-40c7-8a16-505488a6f932 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:25.820206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e343e27-698d-40c7-8a16-505488a6f932 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:25.855608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309942-448d-427e-8708-77ff3e377039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:25.856311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309942-448d-427e-8708-77ff3e377039 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:25.856587 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309942-448d-427e-8708-77ff3e377039 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:25.856855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309942-448d-427e-8708-77ff3e377039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:25.867818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309942-448d-427e-8708-77ff3e377039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-f6309942-448d-427e-8708-77ff3e377039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:45:25.875555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:25.876665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:25.877725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 614/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Wed May 4 13:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:25.883127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6453-59ab-4658-ab90-1df0d58a425f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:25.981955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6453-59ab-4658-ab90-1df0d58a425f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:26.015235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:26.015857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:26.016138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:26.016417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:26.017158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] RBAC: Adding query filter params (name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:26.017492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:26.018853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:26.026607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 622/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Wed May 4 13:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:45:26.033313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309942-448d-427e-8708-77ff3e377039 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:26.133950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309942-448d-427e-8708-77ff3e377039 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:26.169666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:26.170458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:26.170770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:26.171045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:26.181590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:26.183052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:26.200451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:26.201403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:26.203002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:26.203002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:26.203002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:26.203002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:26.203002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 615/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:26.208534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:26.307634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92c2e5-a9e8-4d53-9d23-d7886f313691 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:26.341029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:26.341724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:26.342011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:26.342291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:26.343817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:26.344130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:26.345540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:26.358313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 623/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:26.364492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:26.466336 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d0cd5-84ed-4857-86a6-ed75c41d193e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:26.500067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:26.500874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:26.501157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:26.501565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:26.508954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:26.510412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:45:26.525795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:26.526874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:26.528309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 616/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:26.532970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:26.629823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084d78d-d90d-4b2c-8378-7ffd4bbae5a5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:26.666093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:26.666764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:26.667089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:26.667368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:26.668213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:26.668522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:26.670051 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:26.687954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 624/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 13:45:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:26.693800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:26.798727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1fd88-2d28-4774-b41c-4893fa6bbe8e None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:26.847961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9652fb-62cc-43dd-a179-41d14afcfbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:26.848612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9652fb-62cc-43dd-a179-41d14afcfbea None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:26.848899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9652fb-62cc-43dd-a179-41d14afcfbea None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:26.849180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9652fb-62cc-43dd-a179-41d14afcfbea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:26.916760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9652fb-62cc-43dd-a179-41d14afcfbea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:26.918255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9652fb-62cc-43dd-a179-41d14afcfbea None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:27.017228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 617/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:45:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:45:27.023090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:27.121594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd750-1389-4fff-8916-5374546f1e04 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:27.155835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:27.156592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:27.156880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:27.157155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:27.167402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:27.168842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:27.186633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:27.187734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:27.188771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:27.188771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:27.188771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:27.188771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:27.188771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 625/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:27.194458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9652fb-62cc-43dd-a179-41d14afcfbea None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:27.290554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9652fb-62cc-43dd-a179-41d14afcfbea None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:27.323670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:27.324328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:27.324603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:27.324896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:27.325620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:27.325922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:27.327344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:27.338791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 618/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:27.345330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:27.443038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3fe22-e52e-41b2-87ac-9092c6028831 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:27.478033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:27.478850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:27.479127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:27.479401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:27.486982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:27.488426 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:45:27.502296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:27.503401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:27.504512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 626/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:27.510038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:27.608693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e58bc4-4908-4166-817b-65cd70aa2649 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:27.641216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c04d6-5a86-4e14-b7be-154f12e582c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:27.641911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c04d6-5a86-4e14-b7be-154f12e582c7 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:27.642195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c04d6-5a86-4e14-b7be-154f12e582c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:27.642471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c04d6-5a86-4e14-b7be-154f12e582c7 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:27.643252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c04d6-5a86-4e14-b7be-154f12e582c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:27.643562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c04d6-5a86-4e14-b7be-154f12e582c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:27.645475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c04d6-5a86-4e14-b7be-154f12e582c7 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:27.658552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 619/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:45:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:27.664694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:27.765081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926dedb-564e-4ac4-9df2-c41b0caeb25b None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:27.799510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643d06b-8b43-4fc8-93d5-2339f430f002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:27.800160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d06b-8b43-4fc8-93d5-2339f430f002 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:27.800446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d06b-8b43-4fc8-93d5-2339f430f002 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:27.800757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d06b-8b43-4fc8-93d5-2339f430f002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:27.801649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643d06b-8b43-4fc8-93d5-2339f430f002 None admin] RBAC: Adding query filter params (role.id=0827027c0db142779b191de9ce1ece80, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=06ffd2170c2243eab4511fced8d67ab1) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:27.801964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643d06b-8b43-4fc8-93d5-2339f430f002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:27.803390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643d06b-8b43-4fc8-93d5-2339f430f002 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:27.809269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 627/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:45:27 2022] GET /identity/v3/role_assignments?user.id=06ffd2170c2243eab4511fced8d67ab1&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=0827027c0db142779b191de9ce1ece80 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:30.120260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ea8f7-4a26-41e5-bdbc-8da35e27c18c None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:30.120912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ea8f7-4a26-41e5-bdbc-8da35e27c18c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:30.120912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ea8f7-4a26-41e5-bdbc-8da35e27c18c None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:30.122175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 620/1247] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:30.128100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022d2c-fb36-4562-b782-b72ddfd3cb18 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:30.128504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022d2c-fb36-4562-b782-b72ddfd3cb18 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:30.128667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7022d2c-fb36-4562-b782-b72ddfd3cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:30.145979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-e7022d2c-fb36-4562-b782-b72ddfd3cb18 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:30.147193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e7022d2c-fb36-4562-b782-b72ddfd3cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:30.211964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 628/1248] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:30.236196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ea8f7-4a26-41e5-bdbc-8da35e27c18c None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:30.338683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ea8f7-4a26-41e5-bdbc-8da35e27c18c None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:30.373196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d305-44b2-488c-b8b9-88b54f155758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:30.378036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d305-44b2-488c-b8b9-88b54f155758 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:30.378329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d305-44b2-488c-b8b9-88b54f155758 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:30.378606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663d305-44b2-488c-b8b9-88b54f155758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:30.388708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663d305-44b2-488c-b8b9-88b54f155758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-4663d305-44b2-488c-b8b9-88b54f155758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:45:30.396433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:30.397738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:30.398953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 621/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:30.404017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7022d2c-fb36-4562-b782-b72ddfd3cb18 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:30.502874 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7022d2c-fb36-4562-b782-b72ddfd3cb18 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:30.535914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:30.536571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:30.536849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:30.537118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:30.537890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:30.538191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:30.539535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:30.547449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 629/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:30.553177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d305-44b2-488c-b8b9-88b54f155758 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:30.654528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663d305-44b2-488c-b8b9-88b54f155758 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:30.689183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:30.690009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:30.690291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:30.690567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:30.701434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:30.703541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:30.722030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:30.723160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:30.724352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:30.724352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:30.724352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:30.724352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:30.724352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 622/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:30.729331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:30.828716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944585a-600e-4033-b840-deef5bcb9aab None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:30.863011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:30.863667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:30.863953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:30.864234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:30.864959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:30.865293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:30.866660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:30.878950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 630/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:30.884528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:30.981978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c684673-a70a-4731-8566-684f8a2e8156 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:31.016912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:31.017738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:31.018053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:31.018332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:31.026626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:31.028066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:45:31.042653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:31.044544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:31.046715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 623/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:31.051743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:31.149552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497b62e-231e-46c7-821f-04e78997dd06 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:31.181669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:31.182324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:31.182608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:31.182883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:31.183714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:31.184023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:31.185456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:31.203374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 631/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 13:45:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:31.209402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:31.307366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c59f0-4b3a-4742-9417-2f2b5d334c57 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:31.340148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c152-038f-44e9-b7e3-bbc1471c9b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:31.340800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c152-038f-44e9-b7e3-bbc1471c9b4f None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:31.341083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c152-038f-44e9-b7e3-bbc1471c9b4f None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:31.341391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c152-038f-44e9-b7e3-bbc1471c9b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:31.408420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27c152-038f-44e9-b7e3-bbc1471c9b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:31.409913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27c152-038f-44e9-b7e3-bbc1471c9b4f None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:31.510641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 624/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:45:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:45:31.516581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:31.613496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e51aa3-85c3-466e-bef4-5098145e8154 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:31.646512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:31.647303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:31.647588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:31.647868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:31.658993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:31.660446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:31.678689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:31.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:31.680736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:31.680736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:31.680736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:31.680736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:31.680736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 632/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:31.685686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c152-038f-44e9-b7e3-bbc1471c9b4f None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:31.783703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c152-038f-44e9-b7e3-bbc1471c9b4f None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:31.818401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:31.819064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:31.819347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:31.819674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:31.820360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:31.820665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:31.822062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:31.834407 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 625/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:31.840304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:31.941102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4d5b8-2926-41ba-93c8-763435a13388 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:31.976250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:31.983647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:31.983647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:31.983647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:31.985062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:31.986532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:45:32.000206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:32.001202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:32.002148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 633/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:32.007526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:32.105414 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd827704-a0ed-46ff-ba54-4357e8d78be9 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:32.141124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e2195-85d8-4104-a416-9be5bd8aa313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:32.141882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e2195-85d8-4104-a416-9be5bd8aa313 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:32.142160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e2195-85d8-4104-a416-9be5bd8aa313 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:32.142428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e2195-85d8-4104-a416-9be5bd8aa313 None admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:32.143213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e2195-85d8-4104-a416-9be5bd8aa313 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:32.143519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e2195-85d8-4104-a416-9be5bd8aa313 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:32.144975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e2195-85d8-4104-a416-9be5bd8aa313 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:32.157419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 626/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:32.163655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:32.262899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9c25a-6fd4-4dd0-8ec3-c3ba6732d958 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:32.298053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8b81e-9cb0-4008-b16b-b8c242af2c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:32.298702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b81e-9cb0-4008-b16b-b8c242af2c32 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:32.299034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b81e-9cb0-4008-b16b-b8c242af2c32 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:32.299315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8b81e-9cb0-4008-b16b-b8c242af2c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:32.300143 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8b81e-9cb0-4008-b16b-b8c242af2c32 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=06ffd2170c2243eab4511fced8d67ab1) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:32.300452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8b81e-9cb0-4008-b16b-b8c242af2c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:32.301903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8b81e-9cb0-4008-b16b-b8c242af2c32 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:32.307958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 634/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:45:32 2022] GET /identity/v3/role_assignments?user.id=06ffd2170c2243eab4511fced8d67ab1&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=f1d6bdc882c24a2a9389961135865317 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:34.544326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e75f2-9dd2-4a9b-bfdf-059d748a667d None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:34.544929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e75f2-9dd2-4a9b-bfdf-059d748a667d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:34.544929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e75f2-9dd2-4a9b-bfdf-059d748a667d None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:34.547095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 627/1261] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:34.552509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dd646-8ff6-4dca-907d-b0e7b7fad1be None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:34.552942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dd646-8ff6-4dca-907d-b0e7b7fad1be None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:34.553069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8dd646-8ff6-4dca-907d-b0e7b7fad1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:34.570917 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ff8dd646-8ff6-4dca-907d-b0e7b7fad1be None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:34.572087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ff8dd646-8ff6-4dca-907d-b0e7b7fad1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:34.640492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 635/1262] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:34.665221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e75f2-9dd2-4a9b-bfdf-059d748a667d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:34.772497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e75f2-9dd2-4a9b-bfdf-059d748a667d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:34.808511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2a06-87b4-4596-9b28-e04c7bae217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:34.809216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2a06-87b4-4596-9b28-e04c7bae217a None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:34.809529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2a06-87b4-4596-9b28-e04c7bae217a None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:34.809804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d2a06-87b4-4596-9b28-e04c7bae217a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:34.820425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d2a06-87b4-4596-9b28-e04c7bae217a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-430d2a06-87b4-4596-9b28-e04c7bae217a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:45:34.828157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:34.832618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:34.833868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 628/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:45:34.836918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dd646-8ff6-4dca-907d-b0e7b7fad1be None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:34.935206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8dd646-8ff6-4dca-907d-b0e7b7fad1be None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:34.969020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:34.969711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:34.969991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:34.970263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:34.970999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:34.971308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:34.972651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:34.980616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 636/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:34.987257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2a06-87b4-4596-9b28-e04c7bae217a None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:35.086227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d2a06-87b4-4596-9b28-e04c7bae217a None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:35.119540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:35.120327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:35.120607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:35.120904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:35.131405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:35.139127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:35.150473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:35.151569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:35.152666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:35.152666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:35.152666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:35.152666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:35.152666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 629/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:35.158370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:35.254314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ef59-8b21-406f-a4e6-6427a132d206 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:35.287004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:35.287661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:35.287942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:35.288219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:35.288942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:35.289265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:35.290735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:35.303194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 637/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:35.308932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:35.409844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fea74-85fc-499e-be27-7de0826a728b None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:35.442675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:35.443520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:35.443755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:35.444032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:35.451379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:35.452949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:45:35.466857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:35.468537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:35.469562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 630/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:35.474511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:35.578759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cebd9-c7e0-43f2-a704-2fa1f37c95df None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:35.617738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:35.618467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:35.619448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:35.619448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:35.620180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:35.620486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:35.621927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:35.640507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 638/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 13:45:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:35.646282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:35.747738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01debc3a-4044-4269-b770-467d14ac7e44 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:35.782634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:35.783457 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:35.783711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:35.783985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:35.794744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:35.796182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:35.813380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:35.814601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:35.815653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:35.815653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:35.815653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:35.815653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:35.815653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 631/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:35.820823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:35.919241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3326332-07ec-4a3d-b234-8e013ad059b4 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:35.951688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:35.953083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:35.953466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:35.956725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:35.956725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:35.956725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:35.956725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:35.967195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 639/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:45:35.973747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:36.070999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d6b86-bc19-4029-9a25-ef90e9176080 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:36.104590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:36.105401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:36.105684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:36.105956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:36.113129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:36.114597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:45:36.130139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:36.131315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:36.132337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 632/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:45:36.137446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:36.236388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56794-10c4-45de-b3fd-da86da39a45d None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:36.270778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492103e0-fae6-4a3b-b004-abcfb68f74d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:36.271437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492103e0-fae6-4a3b-b004-abcfb68f74d3 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:36.271721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492103e0-fae6-4a3b-b004-abcfb68f74d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:36.272000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492103e0-fae6-4a3b-b004-abcfb68f74d3 None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:36.272789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492103e0-fae6-4a3b-b004-abcfb68f74d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:36.273096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492103e0-fae6-4a3b-b004-abcfb68f74d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:36.274558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492103e0-fae6-4a3b-b004-abcfb68f74d3 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:36.287336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 640/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:36.293437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:36.390113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3168-0457-453c-9fb8-ad4962916ece None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:36.422849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d33fe-d5cd-469b-b445-576fd74558d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:36.423739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d33fe-d5cd-469b-b445-576fd74558d1 None admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:36.424023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d33fe-d5cd-469b-b445-576fd74558d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:36.424299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d33fe-d5cd-469b-b445-576fd74558d1 None admin] PATH_INFO: `/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/06ffd2170c2243eab4511fced8d67ab1/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:36.426371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d33fe-d5cd-469b-b445-576fd74558d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=26c0839f91454b2b94072b6107d12a0b, user_id=06ffd2170c2243eab4511fced8d67ab1, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:36.427798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d33fe-d5cd-469b-b445-576fd74558d1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:36.516490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 633/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Wed May 4 13:45:36 2022] PUT /identity/v3/projects/26c0839f91454b2b94072b6107d12a0b/users/06ffd2170c2243eab4511fced8d67ab1/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:45:38.816847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85b1e-7dcf-4eb0-a9d1-12564f1c2de9 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:38.817447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85b1e-7dcf-4eb0-a9d1-12564f1c2de9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:38.817447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb85b1e-7dcf-4eb0-a9d1-12564f1c2de9 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:38.818817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 641/1274] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:38.824040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a8d5-7912-427f-93a7-ce140ad750ed None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:38.824423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a8d5-7912-427f-93a7-ce140ad750ed None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:38.824594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a8d5-7912-427f-93a7-ce140ad750ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:38.842132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0c06a8d5-7912-427f-93a7-ce140ad750ed None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:38.844019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0c06a8d5-7912-427f-93a7-ce140ad750ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:38.909368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 634/1275] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:38.932761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85b1e-7dcf-4eb0-a9d1-12564f1c2de9 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:39.032931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb85b1e-7dcf-4eb0-a9d1-12564f1c2de9 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:39.066731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240489-e18a-4a38-bfcc-b436671546dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:39.067519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240489-e18a-4a38-bfcc-b436671546dd None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:39.067805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240489-e18a-4a38-bfcc-b436671546dd None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:39.068082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240489-e18a-4a38-bfcc-b436671546dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:39.078617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6240489-e18a-4a38-bfcc-b436671546dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e6240489-e18a-4a38-bfcc-b436671546dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:45:39.086294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:39.087438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:39.088472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 642/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Wed May 4 13:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:39.094191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a8d5-7912-427f-93a7-ce140ad750ed None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:39.195170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a8d5-7912-427f-93a7-ce140ad750ed None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:39.229790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:39.230470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:39.230748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:39.231022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:39.231775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:39.232124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:39.234309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:39.242478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 635/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Wed May 4 13:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:45:39.248394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240489-e18a-4a38-bfcc-b436671546dd None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:39.349414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240489-e18a-4a38-bfcc-b436671546dd None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:39.382742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:39.383528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:39.383867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:39.384149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:39.394509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:39.396025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:39.413210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:39.414365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:39.415446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:39.415446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:39.415446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:39.415446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:39.415446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 643/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:45:39.420419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:39.520486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177da53-bc07-4ff4-bee3-1bc2f1a56b19 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:39.555053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:39.555807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:39.556129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:39.556441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:39.557197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:39.557578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:39.559110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:39.572287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 636/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:39.579003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:39.684051 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f9fa-8408-4b0f-ae5b-7efcd84eda38 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:39.718861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:39.719666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:39.719946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:39.720218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:39.728101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:39.729650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:45:39.744628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:39.745754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:39.746826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 644/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:39.753281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:39.859811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b2901-92c1-4142-b3b6-f8995799b490 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:39.893925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:39.894698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:39.895011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:39.895323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:39.896259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:39.896619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:39.898385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:39.917228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 637/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Wed May 4 13:45:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:39.924389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:40.029116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10411ebe-c813-4a7a-86b0-cbb12b6d4228 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:40.062497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acae75b-4b0a-47c9-a841-59aae44c57b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:40.063175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acae75b-4b0a-47c9-a841-59aae44c57b0 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:40.063463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acae75b-4b0a-47c9-a841-59aae44c57b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:40.063742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acae75b-4b0a-47c9-a841-59aae44c57b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:40.141341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acae75b-4b0a-47c9-a841-59aae44c57b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:40.142808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acae75b-4b0a-47c9-a841-59aae44c57b0 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:40.242232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 645/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Wed May 4 13:45:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:45:40.248059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:40.350421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed871cba-e1c5-4125-8ec3-b261c00d8136 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:40.386091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:40.386906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:40.387188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:40.387462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:40.399874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:40.401936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:45:40.421852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:40.427509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:40.428682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:45:40.428682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:45:40.428682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:45:40.428682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:40.428682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 638/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:40.429033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acae75b-4b0a-47c9-a841-59aae44c57b0 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:40.531764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acae75b-4b0a-47c9-a841-59aae44c57b0 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:40.566536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:40.567201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:40.567486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:40.567762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:40.568539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:40.568948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:40.570438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:40.584471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 646/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Wed May 4 13:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:40.590300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:40.692500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63bdd0-3784-452d-a8a5-1b2d58366e26 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:40.727690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:40.728483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:40.728764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:40.729040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:40.736920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:40.738451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:45:40.753487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application with Lock( May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:40.754446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: ERROR keystone.server.flask.application May 04 13:45:40.755365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 639/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Wed May 4 13:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:40.761266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:40.870268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d77e94-afc5-4489-a56d-08dcd1e19de9 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:40.903808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22a911-ea11-4114-bf0d-bcb21f6a697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:40.904474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a911-ea11-4114-bf0d-bcb21f6a697e None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:40.904753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a911-ea11-4114-bf0d-bcb21f6a697e None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:40.905584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a911-ea11-4114-bf0d-bcb21f6a697e None admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:40.907018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22a911-ea11-4114-bf0d-bcb21f6a697e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:40.907361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22a911-ea11-4114-bf0d-bcb21f6a697e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:40.908797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22a911-ea11-4114-bf0d-bcb21f6a697e None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:40.921731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 647/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Wed May 4 13:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:40.928123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:41.033956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947894c6-8e10-414a-9c44-d80878e28816 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:41.067894 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906f716-6b8d-4f8e-a538-de24ae6081e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:41.068544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f716-6b8d-4f8e-a538-de24ae6081e9 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:41.068824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f716-6b8d-4f8e-a538-de24ae6081e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:41.069098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f716-6b8d-4f8e-a538-de24ae6081e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:41.070058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906f716-6b8d-4f8e-a538-de24ae6081e9 None admin] RBAC: Adding query filter params (role.id=f1d6bdc882c24a2a9389961135865317, scope.project.id=26c0839f91454b2b94072b6107d12a0b, user.id=06ffd2170c2243eab4511fced8d67ab1) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:41.070368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906f716-6b8d-4f8e-a538-de24ae6081e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:41.075929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906f716-6b8d-4f8e-a538-de24ae6081e9 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:41.078290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 640/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Wed May 4 13:45:40 2022] GET /identity/v3/role_assignments?user.id=06ffd2170c2243eab4511fced8d67ab1&scope.project.id=26c0839f91454b2b94072b6107d12a0b&role.id=f1d6bdc882c24a2a9389961135865317 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:43.385600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf84f7-428f-4cbe-8625-fb7483e7de4d None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:43.386221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf84f7-428f-4cbe-8625-fb7483e7de4d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:43.386221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf84f7-428f-4cbe-8625-fb7483e7de4d None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:43.387525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 648/1288] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:43.392812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb284-49d7-4057-a7f8-23b5974cb797 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:43.393263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb284-49d7-4057-a7f8-23b5974cb797 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:43.393425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb284-49d7-4057-a7f8-23b5974cb797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:43.411015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d52bb284-49d7-4057-a7f8-23b5974cb797 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:43.412234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d52bb284-49d7-4057-a7f8-23b5974cb797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:43.478829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 641/1289] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:43.502984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf84f7-428f-4cbe-8625-fb7483e7de4d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:43.605613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf84f7-428f-4cbe-8625-fb7483e7de4d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:43.638728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:43.639580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:43.639869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:43.640148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:43.640811 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:43.642267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:43.654626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:43.656774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:43.657697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 649/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:45:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:43.663461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bb284-49d7-4057-a7f8-23b5974cb797 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:43.762764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bb284-49d7-4057-a7f8-23b5974cb797 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:43.797262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7e2ae-ba2c-48cb-b05d-821f73ea6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:43.798014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7e2ae-ba2c-48cb-b05d-821f73ea6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:43.798238 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7e2ae-ba2c-48cb-b05d-821f73ea6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:43.798517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7e2ae-ba2c-48cb-b05d-821f73ea6ae1 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:43.799233 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7e2ae-ba2c-48cb-b05d-821f73ea6ae1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:43.799541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7e2ae-ba2c-48cb-b05d-821f73ea6ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:43.800914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7e2ae-ba2c-48cb-b05d-821f73ea6ae1 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:43.805816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 642/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Wed May 4 13:45:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:43.811819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:43.912276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee26c24-a97f-4f96-8c0f-fc68c17709c5 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:43.944618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf342e-40f5-4bd0-9eb2-36db4ad6b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:43.945302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf342e-40f5-4bd0-9eb2-36db4ad6b8ed None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:43.945589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf342e-40f5-4bd0-9eb2-36db4ad6b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:43.945866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf342e-40f5-4bd0-9eb2-36db4ad6b8ed None admin] PATH_INFO: `/v3/services` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:43.946572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf342e-40f5-4bd0-9eb2-36db4ad6b8ed None admin] RBAC: Adding query filter params (type=placement) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:43.946882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf342e-40f5-4bd0-9eb2-36db4ad6b8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:43.948243 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf342e-40f5-4bd0-9eb2-36db4ad6b8ed None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:43.953187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 650/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Wed May 4 13:45:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:46.286713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165867ad-a636-495b-9b7e-52d0f1792f99 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:46.287402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165867ad-a636-495b-9b7e-52d0f1792f99 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:46.287402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165867ad-a636-495b-9b7e-52d0f1792f99 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:46.288717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 643/1293] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:46.294742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4332de-ac02-4374-b43b-e25e412ab0b1 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:46.295185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4332de-ac02-4374-b43b-e25e412ab0b1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:46.295276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4332de-ac02-4374-b43b-e25e412ab0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:46.312972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8e4332de-ac02-4374-b43b-e25e412ab0b1 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:46.314207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8e4332de-ac02-4374-b43b-e25e412ab0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:46.381358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 651/1294] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:46.404720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165867ad-a636-495b-9b7e-52d0f1792f99 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:46.505411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165867ad-a636-495b-9b7e-52d0f1792f99 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:46.540240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07f673-cc54-40f8-b680-4f968b9a2ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:46.540942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07f673-cc54-40f8-b680-4f968b9a2ac6 None admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:46.541145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07f673-cc54-40f8-b680-4f968b9a2ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:46.541451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07f673-cc54-40f8-b680-4f968b9a2ac6 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:46.542171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07f673-cc54-40f8-b680-4f968b9a2ac6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:46.543554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07f673-cc54-40f8-b680-4f968b9a2ac6 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:46.682983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 644/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Wed May 4 13:45:46 2022] POST /identity/v3/services => generated 246 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:45:49.045500 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a801f12-9a21-4525-988c-81d58ba9b396 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:49.046044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a801f12-9a21-4525-988c-81d58ba9b396 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:49.046044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a801f12-9a21-4525-988c-81d58ba9b396 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:49.047227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 652/1296] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:49.052483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089728-dd9b-43e7-81ed-1f441eabe202 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:49.052945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089728-dd9b-43e7-81ed-1f441eabe202 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:49.053053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089728-dd9b-43e7-81ed-1f441eabe202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:49.070023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-be089728-dd9b-43e7-81ed-1f441eabe202 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:49.071209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-be089728-dd9b-43e7-81ed-1f441eabe202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:49.142999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 645/1297] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:45:49.166036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a801f12-9a21-4525-988c-81d58ba9b396 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:49.266966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a801f12-9a21-4525-988c-81d58ba9b396 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:49.300672 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:49.301449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:49.301737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:49.302014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:49.302666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:49.304071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:49.317869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:49.318988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:49.320297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 653/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:45:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:49.325267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089728-dd9b-43e7-81ed-1f441eabe202 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:49.422781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089728-dd9b-43e7-81ed-1f441eabe202 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:49.456053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:49.456717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:49.457201 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:49.457503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:49.458213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:49.458514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:49.459870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:49.465243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 646/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Wed May 4 13:45:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:49.471474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:49.576421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3b594-ca3b-442d-808a-4940407d50bb None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:49.610330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c454e32-e10c-4074-b1ad-365e6e0b7240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:49.610999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c454e32-e10c-4074-b1ad-365e6e0b7240 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:49.611283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c454e32-e10c-4074-b1ad-365e6e0b7240 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:49.611556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c454e32-e10c-4074-b1ad-365e6e0b7240 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:49.612395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c454e32-e10c-4074-b1ad-365e6e0b7240 None admin] RBAC: Adding query filter params (interface=public, service_id=b2931106003b4ce19fdc70dd6affa79e, region_id=RegionOne) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:49.612693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c454e32-e10c-4074-b1ad-365e6e0b7240 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:49.614103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c454e32-e10c-4074-b1ad-365e6e0b7240 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:49.620065 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 654/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Wed May 4 13:45:49 2022] GET /identity/v3/endpoints?service_id=b2931106003b4ce19fdc70dd6affa79e&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:49.626535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:49.728623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3a0c7-eb9f-4c56-bb7b-643735aa8856 None admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:49.764647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c185-4dd8-40a7-93a2-91bed836723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:49.765429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c185-4dd8-40a7-93a2-91bed836723c None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:49.765707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c185-4dd8-40a7-93a2-91bed836723c None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:49.769358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c185-4dd8-40a7-93a2-91bed836723c None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:49.769358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6c185-4dd8-40a7-93a2-91bed836723c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:49.769358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6c185-4dd8-40a7-93a2-91bed836723c None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:49.775073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 647/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Wed May 4 13:45:49 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:45:52.035384 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748750c-83ab-4a11-be4b-a86e4d5734d3 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:52.035930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748750c-83ab-4a11-be4b-a86e4d5734d3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:52.035930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748750c-83ab-4a11-be4b-a86e4d5734d3 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:52.037272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 655/1302] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:45:52.043318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a0a0-2177-4e25-aa25-b881fb03bfbe None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:52.043853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a0a0-2177-4e25-aa25-b881fb03bfbe None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:52.043942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a0a0-2177-4e25-aa25-b881fb03bfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:52.062697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0231a0a0-2177-4e25-aa25-b881fb03bfbe None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:45:52.063989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0231a0a0-2177-4e25-aa25-b881fb03bfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:45:52.138080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 648/1303] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:45:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:45:52.163062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748750c-83ab-4a11-be4b-a86e4d5734d3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:52.275287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748750c-83ab-4a11-be4b-a86e4d5734d3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:52.312093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:52.312805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:52.313089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:52.313399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:52.314060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:52.315514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:45:52.327949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:45:52.329046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application with Lock( May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self._enter() May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application return self.creator() May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application created_value = creator( May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: ERROR keystone.server.flask.application May 04 13:45:52.332852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 656/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Wed May 4 13:45:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:45:52.336187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a0a0-2177-4e25-aa25-b881fb03bfbe None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:52.439730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a0a0-2177-4e25-aa25-b881fb03bfbe None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:52.473920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3e770-5889-4b81-bb7f-7e491216efb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:52.474583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e770-5889-4b81-bb7f-7e491216efb2 None admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:52.474861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e770-5889-4b81-bb7f-7e491216efb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:52.475136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e770-5889-4b81-bb7f-7e491216efb2 None admin] PATH_INFO: `/v3/services` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:52.475846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3e770-5889-4b81-bb7f-7e491216efb2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:45:52.476155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3e770-5889-4b81-bb7f-7e491216efb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:52.477538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3e770-5889-4b81-bb7f-7e491216efb2 None admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:52.482785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 649/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Wed May 4 13:45:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:45:52.489754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:45:52.590881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39787a-08c1-4177-9ece-601feac86109 None admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:45:52.626537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2008-01c9-49a0-822e-4b4f41623485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:45:52.627196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2008-01c9-49a0-822e-4b4f41623485 None admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:45:52.627480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2008-01c9-49a0-822e-4b4f41623485 None admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:45:52.627757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2008-01c9-49a0-822e-4b4f41623485 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:45:52.628523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a2008-01c9-49a0-822e-4b4f41623485 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:45:52.629924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a2008-01c9-49a0-822e-4b4f41623485 None admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:45:52.738890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 657/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Wed May 4 13:45:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:54:28.810569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bd1c9-cd70-421b-bab9-756fff554d21 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:28.811630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bd1c9-cd70-421b-bab9-756fff554d21 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:28.812126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bd1c9-cd70-421b-bab9-756fff554d21 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:28.819842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40617fc-2d39-42bc-a2dd-ac9bf36e6575 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:28.827803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40617fc-2d39-42bc-a2dd-ac9bf36e6575 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:28.827803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40617fc-2d39-42bc-a2dd-ac9bf36e6575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:28.828101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 650/1307] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:28 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:28.967851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f40617fc-2d39-42bc-a2dd-ac9bf36e6575 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:28.970205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f40617fc-2d39-42bc-a2dd-ac9bf36e6575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:29.157465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 658/1308] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:29.208215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69c47-758c-4039-a0c1-93aa34c15581 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:29.209094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69c47-758c-4039-a0c1-93aa34c15581 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:29.209631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69c47-758c-4039-a0c1-93aa34c15581 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:29.211088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 651/1309] 10.222.0.69 () {54 vars in 964 bytes} [Wed May 4 13:54:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:29.218031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de05afa-de37-4478-9a86-a6e42221e71e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:29.218430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de05afa-de37-4478-9a86-a6e42221e71e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:29.218593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de05afa-de37-4478-9a86-a6e42221e71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:29.328796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3de05afa-de37-4478-9a86-a6e42221e71e None None] MFA Rules not processed for user `378bf86fc54142ee85dc16cce3664978`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:29.330061 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3de05afa-de37-4478-9a86-a6e42221e71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:29.413467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 659/1310] 10.222.0.69 () {58 vars in 1061 bytes} [Wed May 4 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:54:29.422984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69c47-758c-4039-a0c1-93aa34c15581 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:29.424935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-95a69c47-758c-4039-a0c1-93aa34c15581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:29.549987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69c47-758c-4039-a0c1-93aa34c15581 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:29.633722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ece52-61fc-493d-8579-cf20c58d4a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:29.634384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ece52-61fc-493d-8579-cf20c58d4a20 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:29.634666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ece52-61fc-493d-8579-cf20c58d4a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:29.634940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ece52-61fc-493d-8579-cf20c58d4a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:29.637499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-df7ece52-61fc-493d-8579-cf20c58d4a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:29.768067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ece52-61fc-493d-8579-cf20c58d4a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:29.769571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ece52-61fc-493d-8579-cf20c58d4a20 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:29.790496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 652/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:32.445896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0f02-581a-499b-967e-fe4e056a9413 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:32.446430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0f02-581a-499b-967e-fe4e056a9413 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:32.446521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f0f02-581a-499b-967e-fe4e056a9413 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:32.447833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 660/1312] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:32.453090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c7eee-b807-4346-9c0b-add579dc80d6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:32.453602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c7eee-b807-4346-9c0b-add579dc80d6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:32.453684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c7eee-b807-4346-9c0b-add579dc80d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:32.526120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-369c7eee-b807-4346-9c0b-add579dc80d6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:32.527330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-369c7eee-b807-4346-9c0b-add579dc80d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:32.626663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 653/1313] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:32.667641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0f02-581a-499b-967e-fe4e056a9413 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:32.669223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-dc5f0f02-581a-499b-967e-fe4e056a9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:32.773632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f0f02-581a-499b-967e-fe4e056a9413 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:32.846055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab37192-4982-4654-bd4a-a59f2d6afc01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:32.846703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab37192-4982-4654-bd4a-a59f2d6afc01 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:32.846984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab37192-4982-4654-bd4a-a59f2d6afc01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:32.847253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab37192-4982-4654-bd4a-a59f2d6afc01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:32.849513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3ab37192-4982-4654-bd4a-a59f2d6afc01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:32.958380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab37192-4982-4654-bd4a-a59f2d6afc01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:32.960113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab37192-4982-4654-bd4a-a59f2d6afc01 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:32.979101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 661/1314] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:35.877319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ad58-7b14-41b4-9a00-88f6ece2582a None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:35.877879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ad58-7b14-41b4-9a00-88f6ece2582a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:35.878070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ad58-7b14-41b4-9a00-88f6ece2582a None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:35.879584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 654/1315] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:35.885280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d181-0902-426b-84bf-b579496fef14 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:35.885745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d181-0902-426b-84bf-b579496fef14 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:35.885997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d181-0902-426b-84bf-b579496fef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:35.957196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b128d181-0902-426b-84bf-b579496fef14 None None] MFA Rules not processed for user `84dac3517ebe4f76ae9dfbd924114efe`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:35.958644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b128d181-0902-426b-84bf-b579496fef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:36.060924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 662/1316] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:36.101369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20ad58-7b14-41b4-9a00-88f6ece2582a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:36.102896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4e20ad58-7b14-41b4-9a00-88f6ece2582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:36.207177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20ad58-7b14-41b4-9a00-88f6ece2582a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:36.282364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53634408-eee1-4f2c-8c40-b3469f5fbd1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:36.283020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634408-eee1-4f2c-8c40-b3469f5fbd1a service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:36.283301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634408-eee1-4f2c-8c40-b3469f5fbd1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:36.283572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53634408-eee1-4f2c-8c40-b3469f5fbd1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:36.285215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-53634408-eee1-4f2c-8c40-b3469f5fbd1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:36.397194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53634408-eee1-4f2c-8c40-b3469f5fbd1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:36.398663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53634408-eee1-4f2c-8c40-b3469f5fbd1a service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:36.417123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 655/1317] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:39.608135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40a8ef-a1a6-4bc6-a647-9175b3f6be47 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:39.608676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40a8ef-a1a6-4bc6-a647-9175b3f6be47 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:39.608676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40a8ef-a1a6-4bc6-a647-9175b3f6be47 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:39.610092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 663/1318] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:39.615966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d27a1-0610-4bb2-a219-9a8e04b03b93 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:39.616444 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d27a1-0610-4bb2-a219-9a8e04b03b93 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:39.616806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d27a1-0610-4bb2-a219-9a8e04b03b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:39.686237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-725d27a1-0610-4bb2-a219-9a8e04b03b93 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:39.687453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-725d27a1-0610-4bb2-a219-9a8e04b03b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:39.787181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 656/1319] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:39.842910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158975c9-9167-4cb1-b635-6b95023d228a None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:39.843193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158975c9-9167-4cb1-b635-6b95023d228a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:39.843474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158975c9-9167-4cb1-b635-6b95023d228a None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:39.844853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 664/1320] 10.222.0.69 () {54 vars in 964 bytes} [Wed May 4 13:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:39.851240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edfee7-7771-430b-9bac-4725af04c285 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:39.851529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edfee7-7771-430b-9bac-4725af04c285 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:39.851807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edfee7-7771-430b-9bac-4725af04c285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:39.930795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-56edfee7-7771-430b-9bac-4725af04c285 None None] MFA Rules not processed for user `378bf86fc54142ee85dc16cce3664978`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:39.931909 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-56edfee7-7771-430b-9bac-4725af04c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:40.007111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 657/1321] 10.222.0.69 () {58 vars in 1061 bytes} [Wed May 4 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:40.016251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158975c9-9167-4cb1-b635-6b95023d228a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:40.017794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-158975c9-9167-4cb1-b635-6b95023d228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:40.139987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158975c9-9167-4cb1-b635-6b95023d228a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:40.241359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd04e46-edc0-4f40-b2de-15ae897c9c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:40.242629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04e46-edc0-4f40-b2de-15ae897c9c5c service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:40.243132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04e46-edc0-4f40-b2de-15ae897c9c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:40.243627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd04e46-edc0-4f40-b2de-15ae897c9c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:40.246705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-fcd04e46-edc0-4f40-b2de-15ae897c9c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:40.386156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd04e46-edc0-4f40-b2de-15ae897c9c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:40.387597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd04e46-edc0-4f40-b2de-15ae897c9c5c service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:40.406550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 665/1322] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:44.353588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1397-f207-43ed-8662-7d4a7ae30c57 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:44.354130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1397-f207-43ed-8662-7d4a7ae30c57 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:44.354130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1397-f207-43ed-8662-7d4a7ae30c57 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:44.355526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 658/1323] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:44.360742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0ce4-37a3-43bb-9e5a-26323d9af33d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:44.361203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0ce4-37a3-43bb-9e5a-26323d9af33d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:44.361327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0ce4-37a3-43bb-9e5a-26323d9af33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:44.427494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-bc6c0ce4-37a3-43bb-9e5a-26323d9af33d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:44.428729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-bc6c0ce4-37a3-43bb-9e5a-26323d9af33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:44.523613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 666/1324] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:44.559225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec1397-f207-43ed-8662-7d4a7ae30c57 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:44.560731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e4ec1397-f207-43ed-8662-7d4a7ae30c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:44.664836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec1397-f207-43ed-8662-7d4a7ae30c57 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:44.740030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40121e8d-6364-4e22-9707-2273ddc3b584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:44.740683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40121e8d-6364-4e22-9707-2273ddc3b584 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:44.741433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40121e8d-6364-4e22-9707-2273ddc3b584 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:44.742811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40121e8d-6364-4e22-9707-2273ddc3b584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:44.743866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-40121e8d-6364-4e22-9707-2273ddc3b584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:44.872314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40121e8d-6364-4e22-9707-2273ddc3b584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:44.874086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40121e8d-6364-4e22-9707-2273ddc3b584 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:44.892452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 659/1325] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:47.278194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dfc7e-9d3e-4a8a-9785-685474b42bc3 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:47.278830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dfc7e-9d3e-4a8a-9785-685474b42bc3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:47.278830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dfc7e-9d3e-4a8a-9785-685474b42bc3 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:47.280278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 667/1326] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:47.286680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270f2a5-5a7f-4dae-8512-020d8efe8858 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:47.286680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270f2a5-5a7f-4dae-8512-020d8efe8858 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:47.287438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270f2a5-5a7f-4dae-8512-020d8efe8858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:47.355381 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b270f2a5-5a7f-4dae-8512-020d8efe8858 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:47.356674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b270f2a5-5a7f-4dae-8512-020d8efe8858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:47.460940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 660/1327] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:47.501697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dfc7e-9d3e-4a8a-9785-685474b42bc3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:47.503227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-806dfc7e-9d3e-4a8a-9785-685474b42bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:47.614677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dfc7e-9d3e-4a8a-9785-685474b42bc3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:47.690446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a872a4-abe7-468c-8992-24cc4672b48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:47.691091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a872a4-abe7-468c-8992-24cc4672b48a service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:47.691374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a872a4-abe7-468c-8992-24cc4672b48a service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:47.691643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a872a4-abe7-468c-8992-24cc4672b48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:47.694009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-82a872a4-abe7-468c-8992-24cc4672b48a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:47.809825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a872a4-abe7-468c-8992-24cc4672b48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:47.811267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a872a4-abe7-468c-8992-24cc4672b48a service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:47.830163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 668/1328] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:50.172046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb490d-85fc-44cf-a7b8-445f9f53f5f6 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:50.172614 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb490d-85fc-44cf-a7b8-445f9f53f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:50.172614 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb490d-85fc-44cf-a7b8-445f9f53f5f6 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:50.174056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 661/1329] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:50.180056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179824-c899-4974-9071-85b22dae2c1e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:50.180562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179824-c899-4974-9071-85b22dae2c1e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:50.180671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179824-c899-4974-9071-85b22dae2c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:50.245767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ec179824-c899-4974-9071-85b22dae2c1e None None] MFA Rules not processed for user `84dac3517ebe4f76ae9dfbd924114efe`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:50.246978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ec179824-c899-4974-9071-85b22dae2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:50.343037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 669/1330] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:50.381452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb490d-85fc-44cf-a7b8-445f9f53f5f6 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:50.382990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e7bb490d-85fc-44cf-a7b8-445f9f53f5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:50.491322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb490d-85fc-44cf-a7b8-445f9f53f5f6 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:50.568216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e255e-2be9-4662-a02d-1a8ba346203a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:50.568879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e255e-2be9-4662-a02d-1a8ba346203a service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:50.569159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e255e-2be9-4662-a02d-1a8ba346203a service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:50.569460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e255e-2be9-4662-a02d-1a8ba346203a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:50.571256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b68e255e-2be9-4662-a02d-1a8ba346203a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:50.684497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e255e-2be9-4662-a02d-1a8ba346203a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:50.686123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e255e-2be9-4662-a02d-1a8ba346203a service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:50.705161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 662/1331] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:53.598359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415b036-0647-4845-a44f-87c1b16a58ce None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:53.598906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415b036-0647-4845-a44f-87c1b16a58ce None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:53.599036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415b036-0647-4845-a44f-87c1b16a58ce None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:53.600487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 670/1332] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:53.605833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227144-0198-4397-9764-e0cf91e2c7d6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:53.606285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227144-0198-4397-9764-e0cf91e2c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:53.606397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af227144-0198-4397-9764-e0cf91e2c7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:53.672859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-af227144-0198-4397-9764-e0cf91e2c7d6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:53.674122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-af227144-0198-4397-9764-e0cf91e2c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:53.776613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 663/1333] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:53.813739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415b036-0647-4845-a44f-87c1b16a58ce None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:53.815285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9415b036-0647-4845-a44f-87c1b16a58ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:53.932851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415b036-0647-4845-a44f-87c1b16a58ce None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:54.010582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9f492-f20a-4c8a-b69b-a12f41fa4b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:54.011243 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f492-f20a-4c8a-b69b-a12f41fa4b13 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:54.011527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f492-f20a-4c8a-b69b-a12f41fa4b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:54.011806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f492-f20a-4c8a-b69b-a12f41fa4b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:54.013510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c1b9f492-f20a-4c8a-b69b-a12f41fa4b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:54.123848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9f492-f20a-4c8a-b69b-a12f41fa4b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:54.125315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9f492-f20a-4c8a-b69b-a12f41fa4b13 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:54.144023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 671/1334] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:56.497368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80c0c-0ee4-45ec-bdd6-31be52c0722e None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:56.497888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80c0c-0ee4-45ec-bdd6-31be52c0722e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:56.497888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea80c0c-0ee4-45ec-bdd6-31be52c0722e None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:56.499215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 664/1335] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:56.504424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd032c-3376-44d8-8e4e-20dc80e9d7c7 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:56.504832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd032c-3376-44d8-8e4e-20dc80e9d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:56.505098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd032c-3376-44d8-8e4e-20dc80e9d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:56.568531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-76bd032c-3376-44d8-8e4e-20dc80e9d7c7 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:56.569749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-76bd032c-3376-44d8-8e4e-20dc80e9d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:56.665756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 672/1336] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:56.706516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea80c0c-0ee4-45ec-bdd6-31be52c0722e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:56.708708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1ea80c0c-0ee4-45ec-bdd6-31be52c0722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:56.814000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea80c0c-0ee4-45ec-bdd6-31be52c0722e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:56.889311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c419a-426e-4fd5-92c0-df872909b2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:56.889954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c419a-426e-4fd5-92c0-df872909b2fb service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:56.890235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c419a-426e-4fd5-92c0-df872909b2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:56.890509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c419a-426e-4fd5-92c0-df872909b2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:56.892149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-167c419a-426e-4fd5-92c0-df872909b2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:57.000479 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c419a-426e-4fd5-92c0-df872909b2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:57.001961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c419a-426e-4fd5-92c0-df872909b2fb service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:57.021190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 665/1337] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:59.897569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32dd10-9dce-4787-b4c6-e26ba7365392 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:59.898161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32dd10-9dce-4787-b4c6-e26ba7365392 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:59.898161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32dd10-9dce-4787-b4c6-e26ba7365392 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:59.899531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 673/1338] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:59.904898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573ecc7-f014-47cb-b83c-0c774261793d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:59.905351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573ecc7-f014-47cb-b83c-0c774261793d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:59.905491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573ecc7-f014-47cb-b83c-0c774261793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:59.975044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4573ecc7-f014-47cb-b83c-0c774261793d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:59.976232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4573ecc7-f014-47cb-b83c-0c774261793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:00.078004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 666/1339] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:55:00.114608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32dd10-9dce-4787-b4c6-e26ba7365392 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:00.116746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-cc32dd10-9dce-4787-b4c6-e26ba7365392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:00.210893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32dd10-9dce-4787-b4c6-e26ba7365392 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:00.214408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3855ced-b2dc-47f0-8595-dfdbd399b29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:00.215042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855ced-b2dc-47f0-8595-dfdbd399b29b service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:00.215326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855ced-b2dc-47f0-8595-dfdbd399b29b service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:00.215601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855ced-b2dc-47f0-8595-dfdbd399b29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:00.224599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3855ced-b2dc-47f0-8595-dfdbd399b29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:00.226034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3855ced-b2dc-47f0-8595-dfdbd399b29b service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:00.235057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 674/1340] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:05.062045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7f71-66af-4fa0-aa3d-6f42ee8a1bc2 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:05.062045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7f71-66af-4fa0-aa3d-6f42ee8a1bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:05.062045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b7f71-66af-4fa0-aa3d-6f42ee8a1bc2 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:05.062045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 667/1341] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:05.065071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aecf45-52a0-4946-ab67-d7a9a5c5f7ca None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:05.065545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aecf45-52a0-4946-ab67-d7a9a5c5f7ca None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:05.065690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aecf45-52a0-4946-ab67-d7a9a5c5f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:05.098906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b8aecf45-52a0-4946-ab67-d7a9a5c5f7ca None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:05.100142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b8aecf45-52a0-4946-ab67-d7a9a5c5f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:05.191129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 675/1342] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:05.231501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b7f71-66af-4fa0-aa3d-6f42ee8a1bc2 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:05.233230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ae9b7f71-66af-4fa0-aa3d-6f42ee8a1bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:05.247164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b7f71-66af-4fa0-aa3d-6f42ee8a1bc2 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:05.250770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577901d9-72a8-4a66-ad42-8ac54684fb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:05.251423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577901d9-72a8-4a66-ad42-8ac54684fb25 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:05.251705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577901d9-72a8-4a66-ad42-8ac54684fb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:05.251984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577901d9-72a8-4a66-ad42-8ac54684fb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:05.262510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577901d9-72a8-4a66-ad42-8ac54684fb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:05.264128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577901d9-72a8-4a66-ad42-8ac54684fb25 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:05.274530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 668/1343] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:08.579695 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70d8fd-2493-4d11-b114-421686f987fb None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:08.580226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70d8fd-2493-4d11-b114-421686f987fb None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:08.580226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70d8fd-2493-4d11-b114-421686f987fb None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:08.581565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 676/1344] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:08.587465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0a0f-9117-4bc8-b33c-d5b131d434ad None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:08.587906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0a0f-9117-4bc8-b33c-d5b131d434ad None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:08.588028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0a0f-9117-4bc8-b33c-d5b131d434ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:08.606996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6d6f0a0f-9117-4bc8-b33c-d5b131d434ad None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:08.608184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6d6f0a0f-9117-4bc8-b33c-d5b131d434ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:08.616450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 669/1345] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:08.654634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70d8fd-2493-4d11-b114-421686f987fb None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:08.667067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70d8fd-2493-4d11-b114-421686f987fb None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:08.670868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7f0be-eda2-4234-bf77-bb0ee816388d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:08.671443 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7f0be-eda2-4234-bf77-bb0ee816388d service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:08.671724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7f0be-eda2-4234-bf77-bb0ee816388d service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:08.672014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7f0be-eda2-4234-bf77-bb0ee816388d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:08.681581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7f0be-eda2-4234-bf77-bb0ee816388d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:08.685426 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7f0be-eda2-4234-bf77-bb0ee816388d service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:08.692773 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 677/1346] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:13.629441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203997d4-cc55-4364-a662-de2a4be5eee3 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:13.629441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203997d4-cc55-4364-a662-de2a4be5eee3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:13.630243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203997d4-cc55-4364-a662-de2a4be5eee3 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:13.631342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 670/1347] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:13.636580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84b52-996f-46ec-a819-eaf8b8470cbb None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:13.637298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84b52-996f-46ec-a819-eaf8b8470cbb None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:13.637698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84b52-996f-46ec-a819-eaf8b8470cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:13.658928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-62a84b52-996f-46ec-a819-eaf8b8470cbb None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:13.660158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-62a84b52-996f-46ec-a819-eaf8b8470cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:13.668593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 678/1348] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:55:13.705614 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203997d4-cc55-4364-a662-de2a4be5eee3 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:13.716866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203997d4-cc55-4364-a662-de2a4be5eee3 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:13.720325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6a7ce-a8fd-4585-b58c-4beaa1c5707e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:13.720954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a7ce-a8fd-4585-b58c-4beaa1c5707e service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:13.721231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a7ce-a8fd-4585-b58c-4beaa1c5707e service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:13.721527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a7ce-a8fd-4585-b58c-4beaa1c5707e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:13.731219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6a7ce-a8fd-4585-b58c-4beaa1c5707e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:13.732641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6a7ce-a8fd-4585-b58c-4beaa1c5707e service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:13.742728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 671/1349] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:19.236998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85133789-d61b-49f0-9c97-db657837001d None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:19.240662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85133789-d61b-49f0-9c97-db657837001d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:19.241138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85133789-d61b-49f0-9c97-db657837001d None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:19.243294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 679/1350] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 13:55:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:19.248972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30636c3-eb21-4ba0-a81c-154361fc9b09 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:19.249824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30636c3-eb21-4ba0-a81c-154361fc9b09 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:19.250288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30636c3-eb21-4ba0-a81c-154361fc9b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:19.413222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a30636c3-eb21-4ba0-a81c-154361fc9b09 None None] MFA Rules not processed for user `06ffd2170c2243eab4511fced8d67ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:19.416943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a30636c3-eb21-4ba0-a81c-154361fc9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:19.603174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 672/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 13:55:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:23.882955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d1ac8-a8e4-41e1-920c-46d88be41c18 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:23.883904 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d1ac8-a8e4-41e1-920c-46d88be41c18 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:23.884360 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d1ac8-a8e4-41e1-920c-46d88be41c18 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:23.886091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 680/1352] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 13:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:23.892423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694626ca-90b4-49ec-9d44-e40ba9afd71b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:23.893029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694626ca-90b4-49ec-9d44-e40ba9afd71b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:23.893029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694626ca-90b4-49ec-9d44-e40ba9afd71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:23.918045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-694626ca-90b4-49ec-9d44-e40ba9afd71b None None] MFA Rules not processed for user `06ffd2170c2243eab4511fced8d67ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:23.919464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-694626ca-90b4-49ec-9d44-e40ba9afd71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:23.928431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 673/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 13:55:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:25.360589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109d0ff-7bdf-4b0c-af0d-55a68136614e None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:25.361135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109d0ff-7bdf-4b0c-af0d-55a68136614e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:25.361135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109d0ff-7bdf-4b0c-af0d-55a68136614e None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:25.362512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 681/1354] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 13:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:25.368037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35ef8-cffd-495e-94fa-6b64b50a649e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:25.368486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35ef8-cffd-495e-94fa-6b64b50a649e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:25.368586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35ef8-cffd-495e-94fa-6b64b50a649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:25.387944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e3f35ef8-cffd-495e-94fa-6b64b50a649e None None] MFA Rules not processed for user `06ffd2170c2243eab4511fced8d67ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:25.389147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e3f35ef8-cffd-495e-94fa-6b64b50a649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:25.399351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 674/1355] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 13:55:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:29.313486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebb149-935b-424f-aee1-b190eeb8382b None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.314029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebb149-935b-424f-aee1-b190eeb8382b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.315162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebb149-935b-424f-aee1-b190eeb8382b None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.318391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 682/1356] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:29.324133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd850db-4cc6-4ba3-b926-4a9323cbd954 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.324715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd850db-4cc6-4ba3-b926-4a9323cbd954 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.324715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd850db-4cc6-4ba3-b926-4a9323cbd954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.346323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-5bd850db-4cc6-4ba3-b926-4a9323cbd954 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:29.348332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5bd850db-4cc6-4ba3-b926-4a9323cbd954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:29.358114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 675/1357] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:29.414640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc6ce-f761-4edb-95ca-6b4ab6836bbd None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.415302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc6ce-f761-4edb-95ca-6b4ab6836bbd None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.415680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bc6ce-f761-4edb-95ca-6b4ab6836bbd None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.418411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 683/1358] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 13:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:29.423341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eccc1-2901-4eee-8ba0-6eaa2ba98b3a None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.423755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eccc1-2901-4eee-8ba0-6eaa2ba98b3a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.424378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eccc1-2901-4eee-8ba0-6eaa2ba98b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.486534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b07eccc1-2901-4eee-8ba0-6eaa2ba98b3a None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:29.488206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b07eccc1-2901-4eee-8ba0-6eaa2ba98b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:29.591987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 676/1359] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:55:29.601125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bc6ce-f761-4edb-95ca-6b4ab6836bbd None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:29.619018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bc6ce-f761-4edb-95ca-6b4ab6836bbd None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:29.629728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc36133-3922-45b7-8a28-187c2555e843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:29.630563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36133-3922-45b7-8a28-187c2555e843 service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.630941 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36133-3922-45b7-8a28-187c2555e843 service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.631523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36133-3922-45b7-8a28-187c2555e843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.642448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc36133-3922-45b7-8a28-187c2555e843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:29.645369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc36133-3922-45b7-8a28-187c2555e843 service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:29.657666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 684/1360] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:32.207646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573f56-a804-4f07-b908-a3541a0287c9 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:32.208181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573f56-a804-4f07-b908-a3541a0287c9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:32.208463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06573f56-a804-4f07-b908-a3541a0287c9 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:32.210064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 677/1361] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:32.215566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c18f-c72f-4435-803c-a0394884e182 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:32.217775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c18f-c72f-4435-803c-a0394884e182 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:32.218088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c18f-c72f-4435-803c-a0394884e182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:32.239408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f7e1c18f-c72f-4435-803c-a0394884e182 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:32.241483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f7e1c18f-c72f-4435-803c-a0394884e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:32.250279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 685/1362] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:32.299877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06573f56-a804-4f07-b908-a3541a0287c9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:32.318450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06573f56-a804-4f07-b908-a3541a0287c9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:32.326511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4f27-df8c-454d-add2-5aab0c7d6a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:32.327874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4f27-df8c-454d-add2-5aab0c7d6a9b service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:32.328393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4f27-df8c-454d-add2-5aab0c7d6a9b service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:32.328890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4f27-df8c-454d-add2-5aab0c7d6a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:32.340823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4f27-df8c-454d-add2-5aab0c7d6a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:32.343787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4f27-df8c-454d-add2-5aab0c7d6a9b service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:32.358872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 678/1363] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:35.219895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59496-da95-4027-88ef-ac398f08c847 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:35.220402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59496-da95-4027-88ef-ac398f08c847 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:35.220616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59496-da95-4027-88ef-ac398f08c847 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:35.221878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 686/1364] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:35.227271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7967-0c2f-424d-898e-bafd99fb694c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:35.231697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7967-0c2f-424d-898e-bafd99fb694c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:35.231697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7967-0c2f-424d-898e-bafd99fb694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:35.246734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-463e7967-0c2f-424d-898e-bafd99fb694c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:35.247986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-463e7967-0c2f-424d-898e-bafd99fb694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:35.256840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 679/1365] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:35.309326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e786f-07c9-4857-928a-f7aff26ddc8e None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:35.309645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e786f-07c9-4857-928a-f7aff26ddc8e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:35.310102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e786f-07c9-4857-928a-f7aff26ddc8e None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:35.311522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 687/1366] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 13:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:35.325936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1175a1-1ba2-4384-8a4d-2c26b891c316 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:35.326217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1175a1-1ba2-4384-8a4d-2c26b891c316 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:35.326490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1175a1-1ba2-4384-8a4d-2c26b891c316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:35.351831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3a1175a1-1ba2-4384-8a4d-2c26b891c316 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:35.353032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3a1175a1-1ba2-4384-8a4d-2c26b891c316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:35.373156 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 680/1367] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 13:55:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:35.374310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e786f-07c9-4857-928a-f7aff26ddc8e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:35.394288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e786f-07c9-4857-928a-f7aff26ddc8e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:35.400551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53772c-e519-4ddf-8735-0140af189b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:35.401697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53772c-e519-4ddf-8735-0140af189b4b service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:35.401980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53772c-e519-4ddf-8735-0140af189b4b service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:35.402257 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53772c-e519-4ddf-8735-0140af189b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:35.412766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53772c-e519-4ddf-8735-0140af189b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:35.414663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53772c-e519-4ddf-8735-0140af189b4b service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:35.426981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 688/1368] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:37.763761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784afae-0c9b-464d-9c60-c11334b90318 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:37.764304 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784afae-0c9b-464d-9c60-c11334b90318 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:37.764304 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784afae-0c9b-464d-9c60-c11334b90318 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:37.765859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 681/1369] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:37.772966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4d6d-40bc-4f45-ba7e-531f25c29979 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:37.773642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4d6d-40bc-4f45-ba7e-531f25c29979 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:37.773642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c4d6d-40bc-4f45-ba7e-531f25c29979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:37.793300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-6a8c4d6d-40bc-4f45-ba7e-531f25c29979 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:37.794645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6a8c4d6d-40bc-4f45-ba7e-531f25c29979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:37.804025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 689/1370] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:37.953230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5549f-b8d4-4844-8db4-9e4d5dc3dc3a None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:37.953551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5549f-b8d4-4844-8db4-9e4d5dc3dc3a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:37.954084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5549f-b8d4-4844-8db4-9e4d5dc3dc3a None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:37.955598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 682/1371] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:37.962050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425dfe-5799-4720-b24b-af35206a4f47 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:37.962405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425dfe-5799-4720-b24b-af35206a4f47 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:37.962764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425dfe-5799-4720-b24b-af35206a4f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:37.982171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5f425dfe-5799-4720-b24b-af35206a4f47 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:37.983368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5f425dfe-5799-4720-b24b-af35206a4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:38.001277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 690/1372] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:38.039330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5549f-b8d4-4844-8db4-9e4d5dc3dc3a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:38.054198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5549f-b8d4-4844-8db4-9e4d5dc3dc3a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:38.060256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f95b-65cc-4532-9720-54f1d3b21153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:38.060981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f95b-65cc-4532-9720-54f1d3b21153 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:38.061368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f95b-65cc-4532-9720-54f1d3b21153 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:38.061722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f95b-65cc-4532-9720-54f1d3b21153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:38.071531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471f95b-65cc-4532-9720-54f1d3b21153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:38.073296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471f95b-65cc-4532-9720-54f1d3b21153 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:38.084204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 683/1373] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:38.130619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891ff5-6001-4630-adbe-e111283ab9af None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:38.130619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891ff5-6001-4630-adbe-e111283ab9af None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:38.130619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891ff5-6001-4630-adbe-e111283ab9af None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:38.135204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 691/1374] 10.222.0.69 () {54 vars in 963 bytes} [Wed May 4 13:55:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:38.139882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf7dd0-737b-46aa-879e-67d076bf17a2 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:38.140175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf7dd0-737b-46aa-879e-67d076bf17a2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:38.140457 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf7dd0-737b-46aa-879e-67d076bf17a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:38.203977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-bdbf7dd0-737b-46aa-879e-67d076bf17a2 None None] MFA Rules not processed for user `ec9c893558b74cf89012a50734d06ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:38.203977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bdbf7dd0-737b-46aa-879e-67d076bf17a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:38.257622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 684/1375] 10.222.0.69 () {58 vars in 1060 bytes} [Wed May 4 13:55:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:38.265209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de891ff5-6001-4630-adbe-e111283ab9af None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:38.276694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de891ff5-6001-4630-adbe-e111283ab9af None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:38.280869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c367dc5-d7b5-414c-84ea-8059161b7461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:38.281543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367dc5-d7b5-414c-84ea-8059161b7461 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:38.281831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367dc5-d7b5-414c-84ea-8059161b7461 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:38.282110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367dc5-d7b5-414c-84ea-8059161b7461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:38.292657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c367dc5-d7b5-414c-84ea-8059161b7461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:38.294255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c367dc5-d7b5-414c-84ea-8059161b7461 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:38.304935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 692/1376] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:40.598630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a81af-fd29-4e51-8c60-d505f3f13da4 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.599175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a81af-fd29-4e51-8c60-d505f3f13da4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.599276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a81af-fd29-4e51-8c60-d505f3f13da4 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.600596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 685/1377] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:40.607109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83304e5-a66e-4418-81ab-4e8a3337c7be None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.607580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83304e5-a66e-4418-81ab-4e8a3337c7be None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.607674 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83304e5-a66e-4418-81ab-4e8a3337c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.627429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f83304e5-a66e-4418-81ab-4e8a3337c7be None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:40.629722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f83304e5-a66e-4418-81ab-4e8a3337c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:40.637692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 693/1378] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:40.682649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a81af-fd29-4e51-8c60-d505f3f13da4 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:40.698139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a81af-fd29-4e51-8c60-d505f3f13da4 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:40.707056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d456c-9e6c-4a23-89e6-58941f0bf767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:40.707871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d456c-9e6c-4a23-89e6-58941f0bf767 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.708161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d456c-9e6c-4a23-89e6-58941f0bf767 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.708441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d456c-9e6c-4a23-89e6-58941f0bf767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.717476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d456c-9e6c-4a23-89e6-58941f0bf767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:40.719134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d456c-9e6c-4a23-89e6-58941f0bf767 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:40.730238 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 686/1379] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:43.229882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce24b3-4df3-4fd3-b4e9-f63fde69c669 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:43.230437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce24b3-4df3-4fd3-b4e9-f63fde69c669 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:43.230437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce24b3-4df3-4fd3-b4e9-f63fde69c669 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.231842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 694/1380] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:43.238333 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6a98-708b-4c9a-816e-83c7027cf1ae None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:43.238870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6a98-708b-4c9a-816e-83c7027cf1ae None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:43.238989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6a98-708b-4c9a-816e-83c7027cf1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.258008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-aa0c6a98-708b-4c9a-816e-83c7027cf1ae None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:43.259227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-aa0c6a98-708b-4c9a-816e-83c7027cf1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:43.267357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 687/1381] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:43.312554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce24b3-4df3-4fd3-b4e9-f63fde69c669 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:43.328522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce24b3-4df3-4fd3-b4e9-f63fde69c669 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:43.334919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e5644-78df-4ccd-9989-a1c0e2e77984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:43.335749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5644-78df-4ccd-9989-a1c0e2e77984 service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:43.336185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5644-78df-4ccd-9989-a1c0e2e77984 service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:43.336742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e5644-78df-4ccd-9989-a1c0e2e77984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.345821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e5644-78df-4ccd-9989-a1c0e2e77984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:43.348789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e5644-78df-4ccd-9989-a1c0e2e77984 service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:43.359411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 695/1382] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:45.880612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c047-32a8-46cc-931e-b7d573fe4529 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:45.881172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c047-32a8-46cc-931e-b7d573fe4529 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:45.881172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c047-32a8-46cc-931e-b7d573fe4529 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:45.882833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 688/1383] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:45.888057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c0de-094f-4194-896f-dfada6151b95 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:45.888501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c0de-094f-4194-896f-dfada6151b95 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:45.888599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c0de-094f-4194-896f-dfada6151b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:45.909942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9fe2c0de-094f-4194-896f-dfada6151b95 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:45.911239 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9fe2c0de-094f-4194-896f-dfada6151b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:45.919081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 696/1384] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:45.960992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714c047-32a8-46cc-931e-b7d573fe4529 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:45.977478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714c047-32a8-46cc-931e-b7d573fe4529 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:45.983275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ee786-9ac1-411b-8660-384dde6e0cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:45.983923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ee786-9ac1-411b-8660-384dde6e0cd2 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:45.984198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ee786-9ac1-411b-8660-384dde6e0cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:45.984469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ee786-9ac1-411b-8660-384dde6e0cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:45.994961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ee786-9ac1-411b-8660-384dde6e0cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:45.996541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ee786-9ac1-411b-8660-384dde6e0cd2 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:46.007711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 689/1385] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:48.347948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a70498-5a8d-4de4-b4b1-f324c6a89e98 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:48.360792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a70498-5a8d-4de4-b4b1-f324c6a89e98 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:48.360792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a70498-5a8d-4de4-b4b1-f324c6a89e98 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:48.360792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 697/1386] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:48.361079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ad50-e42d-4eb7-ba70-9e21dfbc82f9 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:48.361079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ad50-e42d-4eb7-ba70-9e21dfbc82f9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:48.361079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ad50-e42d-4eb7-ba70-9e21dfbc82f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:48.375685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d5d3ad50-e42d-4eb7-ba70-9e21dfbc82f9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:48.376892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d5d3ad50-e42d-4eb7-ba70-9e21dfbc82f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:48.384966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 690/1387] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:48.430340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a70498-5a8d-4de4-b4b1-f324c6a89e98 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:48.446751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a70498-5a8d-4de4-b4b1-f324c6a89e98 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:48.452094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d084063-8263-42da-b0f6-ee02471ba93a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:48.452761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084063-8263-42da-b0f6-ee02471ba93a service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:48.452984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084063-8263-42da-b0f6-ee02471ba93a service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:48.453287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084063-8263-42da-b0f6-ee02471ba93a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:48.462937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d084063-8263-42da-b0f6-ee02471ba93a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:48.464457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d084063-8263-42da-b0f6-ee02471ba93a service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:48.475156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 698/1388] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:51.573718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f27503-d37a-430a-98b1-66dc3f35a223 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:51.574287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f27503-d37a-430a-98b1-66dc3f35a223 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:51.574287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f27503-d37a-430a-98b1-66dc3f35a223 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:51.575684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 691/1389] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:51.584058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d96cd-1817-42d3-ab2c-dfaf6561b68c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:51.584612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d96cd-1817-42d3-ab2c-dfaf6561b68c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:51.584808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d96cd-1817-42d3-ab2c-dfaf6561b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:51.606945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4b6d96cd-1817-42d3-ab2c-dfaf6561b68c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:51.608635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4b6d96cd-1817-42d3-ab2c-dfaf6561b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:51.620018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 699/1390] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:51.676464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f27503-d37a-430a-98b1-66dc3f35a223 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:51.696075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f27503-d37a-430a-98b1-66dc3f35a223 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:51.702935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33d2bd-a768-42cd-be7e-7f50e1c6f6c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:51.703598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33d2bd-a768-42cd-be7e-7f50e1c6f6c0 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:51.703874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33d2bd-a768-42cd-be7e-7f50e1c6f6c0 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:51.704150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33d2bd-a768-42cd-be7e-7f50e1c6f6c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:51.714813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33d2bd-a768-42cd-be7e-7f50e1c6f6c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:51.716433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33d2bd-a768-42cd-be7e-7f50e1c6f6c0 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:51.727058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 692/1391] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:55:54.319341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925ba40-b645-4f22-a30a-2af3d958dbf8 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.319984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925ba40-b645-4f22-a30a-2af3d958dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.319984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925ba40-b645-4f22-a30a-2af3d958dbf8 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.321378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 700/1392] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:54.326360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517db6f-47b6-4f22-a902-d0e4d8f94ddf None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.326828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517db6f-47b6-4f22-a902-d0e4d8f94ddf None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.326929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517db6f-47b6-4f22-a902-d0e4d8f94ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.344127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0517db6f-47b6-4f22-a902-d0e4d8f94ddf None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:54.345324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0517db6f-47b6-4f22-a902-d0e4d8f94ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:54.353769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 693/1393] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:54.400240 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925ba40-b645-4f22-a30a-2af3d958dbf8 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.415319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925ba40-b645-4f22-a30a-2af3d958dbf8 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.420743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9b7e1-6454-42b2-a094-399c709f6e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.434587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b7e1-6454-42b2-a094-399c709f6e3b service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.434587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b7e1-6454-42b2-a094-399c709f6e3b service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.434587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b7e1-6454-42b2-a094-399c709f6e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.434587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9b7e1-6454-42b2-a094-399c709f6e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.434587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9b7e1-6454-42b2-a094-399c709f6e3b service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.442250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 701/1394] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:54.568132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f624e-7dc9-419d-b2b7-e0ddb59e9e7a None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.568685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f624e-7dc9-419d-b2b7-e0ddb59e9e7a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.568997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f624e-7dc9-419d-b2b7-e0ddb59e9e7a None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.570468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 694/1395] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:54.575623 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc806c0-b290-4643-ac92-5a32a4d8cb76 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.577343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc806c0-b290-4643-ac92-5a32a4d8cb76 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.577343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc806c0-b290-4643-ac92-5a32a4d8cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.595007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-afc806c0-b290-4643-ac92-5a32a4d8cb76 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:54.596202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-afc806c0-b290-4643-ac92-5a32a4d8cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:54.604188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 702/1396] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:54.664299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97242-f171-4f44-b4f1-81e5527c75ef None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.664611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97242-f171-4f44-b4f1-81e5527c75ef None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.665097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97242-f171-4f44-b4f1-81e5527c75ef None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.666563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 695/1397] 10.222.0.69 () {54 vars in 962 bytes} [Wed May 4 13:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:55:54.672338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a5d0-948d-4d64-b47b-f52947cfec09 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.672807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a5d0-948d-4d64-b47b-f52947cfec09 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.672987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a5d0-948d-4d64-b47b-f52947cfec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.728412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5fd0a5d0-948d-4d64-b47b-f52947cfec09 None None] MFA Rules not processed for user `26d96159b7fb49c08b1f5c014d26f79b`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:54.729667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5fd0a5d0-948d-4d64-b47b-f52947cfec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:54.801413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 703/1398] 10.222.0.69 () {58 vars in 1059 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:54.809210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db97242-f171-4f44-b4f1-81e5527c75ef None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.821840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db97242-f171-4f44-b4f1-81e5527c75ef None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.825318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dee20-2118-42c3-88c1-9a9f366351db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d96159b7fb49c08b1f5c014d26f79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.825971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dee20-2118-42c3-88c1-9a9f366351db service glance] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.826448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dee20-2118-42c3-88c1-9a9f366351db service glance] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.826723 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dee20-2118-42c3-88c1-9a9f366351db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.839411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dee20-2118-42c3-88c1-9a9f366351db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.840841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dee20-2118-42c3-88c1-9a9f366351db service glance] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.851952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 696/1399] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:55.445882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b117-af51-4859-80a3-bff08bf6408e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.446413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b117-af51-4859-80a3-bff08bf6408e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.446529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b117-af51-4859-80a3-bff08bf6408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.505736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0761b117-af51-4859-80a3-bff08bf6408e None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:55.507147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0761b117-af51-4859-80a3-bff08bf6408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:55.576560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 704/1400] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:55.621438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e1ab2-8f01-4c60-82a1-68073308c8c4 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.622271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e1ab2-8f01-4c60-82a1-68073308c8c4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.622512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e1ab2-8f01-4c60-82a1-68073308c8c4 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.624274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 697/1401] 10.222.0.69 () {54 vars in 942 bytes} [Wed May 4 13:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:55:55.632059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386be2c-b1b6-4ee7-b01c-1a71deb4f57f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.632535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386be2c-b1b6-4ee7-b01c-1a71deb4f57f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.632956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386be2c-b1b6-4ee7-b01c-1a71deb4f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.689440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1386be2c-b1b6-4ee7-b01c-1a71deb4f57f None None] MFA Rules not processed for user `52aa32e8c0f742659725ddec932014b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:55.690661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1386be2c-b1b6-4ee7-b01c-1a71deb4f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:55.773505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 705/1402] 10.222.0.69 () {58 vars in 1039 bytes} [Wed May 4 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:55.782616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e1ab2-8f01-4c60-82a1-68073308c8c4 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:55.798352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e1ab2-8f01-4c60-82a1-68073308c8c4 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:55.805333 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a195b0-8c30-4590-82eb-0cb2324e7751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:55.806046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a195b0-8c30-4590-82eb-0cb2324e7751 service swift] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.806335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a195b0-8c30-4590-82eb-0cb2324e7751 service swift] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.806675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a195b0-8c30-4590-82eb-0cb2324e7751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.816633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a195b0-8c30-4590-82eb-0cb2324e7751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:55.818302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a195b0-8c30-4590-82eb-0cb2324e7751 service swift] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:55.832346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 698/1403] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 13:55:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:55:56.928967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26e45a-f8d9-4c25-8486-69dc5f66bd1c None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:56.929657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26e45a-f8d9-4c25-8486-69dc5f66bd1c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:56.929657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26e45a-f8d9-4c25-8486-69dc5f66bd1c None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:56.930955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 706/1404] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:56.938200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c01e-5eff-4473-b5f1-c1c476f2f367 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:56.939087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c01e-5eff-4473-b5f1-c1c476f2f367 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:56.939366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c01e-5eff-4473-b5f1-c1c476f2f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:56.962243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-7139c01e-5eff-4473-b5f1-c1c476f2f367 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:56.963875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7139c01e-5eff-4473-b5f1-c1c476f2f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:56.977197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 699/1405] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:57.027039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26e45a-f8d9-4c25-8486-69dc5f66bd1c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:57.042779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26e45a-f8d9-4c25-8486-69dc5f66bd1c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:57.049132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37340583-3627-4059-a2c1-6b9c69a8848a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:57.050389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37340583-3627-4059-a2c1-6b9c69a8848a service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:57.050730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37340583-3627-4059-a2c1-6b9c69a8848a service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:57.051068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37340583-3627-4059-a2c1-6b9c69a8848a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:57.064286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37340583-3627-4059-a2c1-6b9c69a8848a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:57.066937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37340583-3627-4059-a2c1-6b9c69a8848a service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:57.080157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 707/1406] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:55:59.724259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861a38-7add-44fd-9027-a5b7443b17e7 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:59.724853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861a38-7add-44fd-9027-a5b7443b17e7 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:59.724853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c861a38-7add-44fd-9027-a5b7443b17e7 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:59.726525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 700/1407] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:55:59.731668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653312a7-08eb-4d6a-8a3a-e1f4d2556355 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:59.732166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653312a7-08eb-4d6a-8a3a-e1f4d2556355 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:59.732270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653312a7-08eb-4d6a-8a3a-e1f4d2556355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:59.751605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-653312a7-08eb-4d6a-8a3a-e1f4d2556355 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:59.752897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-653312a7-08eb-4d6a-8a3a-e1f4d2556355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:59.761277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 708/1408] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:59.810867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c861a38-7add-44fd-9027-a5b7443b17e7 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:59.827167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c861a38-7add-44fd-9027-a5b7443b17e7 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:59.833291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bf0d7-b59a-4989-b2a0-4b088246d612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:59.833957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf0d7-b59a-4989-b2a0-4b088246d612 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:59.834239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf0d7-b59a-4989-b2a0-4b088246d612 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:59.834649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf0d7-b59a-4989-b2a0-4b088246d612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:59.843960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bf0d7-b59a-4989-b2a0-4b088246d612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:59.845639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bf0d7-b59a-4989-b2a0-4b088246d612 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:59.857051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 701/1409] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:56:21.613898 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d022cfd-c6e0-418a-8113-f08d22cb32c3 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:21.614550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d022cfd-c6e0-418a-8113-f08d22cb32c3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:21.614550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d022cfd-c6e0-418a-8113-f08d22cb32c3 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:21.615878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 709/1410] 10.222.0.69 () {54 vars in 918 bytes} [Wed May 4 13:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:21.621858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bbdf6-35ee-4c51-9bfd-6350e7c15e84 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:21.622337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bbdf6-35ee-4c51-9bfd-6350e7c15e84 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:21.622440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bbdf6-35ee-4c51-9bfd-6350e7c15e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:21.640252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a44bbdf6-35ee-4c51-9bfd-6350e7c15e84 None None] MFA Rules not processed for user `06ffd2170c2243eab4511fced8d67ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:21.641488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a44bbdf6-35ee-4c51-9bfd-6350e7c15e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:21.650053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 702/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Wed May 4 13:56:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:21.666168 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fc86-acbb-4fba-96d4-132fd718428f None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:21.666579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fc86-acbb-4fba-96d4-132fd718428f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:21.666775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728fc86-acbb-4fba-96d4-132fd718428f None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:21.668216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 710/1412] 10.222.0.69 () {54 vars in 918 bytes} [Wed May 4 13:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:21.672873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad523cd-2b5c-410f-bc3e-e59b6ce82b13 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:21.673165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad523cd-2b5c-410f-bc3e-e59b6ce82b13 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:21.673470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad523cd-2b5c-410f-bc3e-e59b6ce82b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:21.691839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3ad523cd-2b5c-410f-bc3e-e59b6ce82b13 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:21.693037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3ad523cd-2b5c-410f-bc3e-e59b6ce82b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:21.702295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 703/1413] 10.222.0.69 () {58 vars in 1015 bytes} [Wed May 4 13:56:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:24.499066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530a8a-f197-4164-8950-ddd2ffbcea49 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:24.499807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530a8a-f197-4164-8950-ddd2ffbcea49 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:24.499807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530a8a-f197-4164-8950-ddd2ffbcea49 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:24.501010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:24.507476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecc8b-5d41-42d2-8bdc-ef8ee65193e4 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:24.508022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecc8b-5d41-42d2-8bdc-ef8ee65193e4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:24.508138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acecc8b-5d41-42d2-8bdc-ef8ee65193e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:24.526724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1acecc8b-5d41-42d2-8bdc-ef8ee65193e4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:24.527916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1acecc8b-5d41-42d2-8bdc-ef8ee65193e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:24.536936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:24.583547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90530a8a-f197-4164-8950-ddd2ffbcea49 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:24.599707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90530a8a-f197-4164-8950-ddd2ffbcea49 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:24.605331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c1b9b-3c6d-47ee-8423-5addcfc153fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:24.605983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1b9b-3c6d-47ee-8423-5addcfc153fd service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:24.606268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1b9b-3c6d-47ee-8423-5addcfc153fd service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:24.606584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1b9b-3c6d-47ee-8423-5addcfc153fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:24.615628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c1b9b-3c6d-47ee-8423-5addcfc153fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:24.617266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c1b9b-3c6d-47ee-8423-5addcfc153fd service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:24.626856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 712/1416] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:25.996926 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9503aff-163f-4d77-939c-690904c341c4 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:25.997555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9503aff-163f-4d77-939c-690904c341c4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:25.997555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9503aff-163f-4d77-939c-690904c341c4 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:25.998907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:26.004775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca54b6-78e8-48d1-be03-33f9662f7274 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:26.005346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca54b6-78e8-48d1-be03-33f9662f7274 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:26.005464 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca54b6-78e8-48d1-be03-33f9662f7274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:26.024313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3cca54b6-78e8-48d1-be03-33f9662f7274 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:26.025481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3cca54b6-78e8-48d1-be03-33f9662f7274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:26.033326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:26.204037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9503aff-163f-4d77-939c-690904c341c4 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:26.219280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9503aff-163f-4d77-939c-690904c341c4 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:26.226061 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e215e-1ddc-42bc-907b-e2d639527a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:26.226750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e215e-1ddc-42bc-907b-e2d639527a15 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:26.227037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e215e-1ddc-42bc-907b-e2d639527a15 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:26.227317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e215e-1ddc-42bc-907b-e2d639527a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:26.236177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e215e-1ddc-42bc-907b-e2d639527a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:26.237925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e215e-1ddc-42bc-907b-e2d639527a15 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:26.247991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 706/1419] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:27.597488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05b2c-557a-4978-9408-f936470b8e28 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:27.598111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05b2c-557a-4978-9408-f936470b8e28 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:27.598111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05b2c-557a-4978-9408-f936470b8e28 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:27.599499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:27.605556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8890-c273-4a6c-8a35-64b38e3fa92c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:27.606198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8890-c273-4a6c-8a35-64b38e3fa92c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:27.606198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb8890-c273-4a6c-8a35-64b38e3fa92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:27.625976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6bcb8890-c273-4a6c-8a35-64b38e3fa92c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:27.627856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6bcb8890-c273-4a6c-8a35-64b38e3fa92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:27.637324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:27.790515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05b2c-557a-4978-9408-f936470b8e28 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:27.806218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05b2c-557a-4978-9408-f936470b8e28 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:27.811748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f97bac-23e7-47c8-ad9b-b50cc2a563ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:27.812390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97bac-23e7-47c8-ad9b-b50cc2a563ca service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:27.813170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97bac-23e7-47c8-ad9b-b50cc2a563ca service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:27.813170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f97bac-23e7-47c8-ad9b-b50cc2a563ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:27.822891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f97bac-23e7-47c8-ad9b-b50cc2a563ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:27.824485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f97bac-23e7-47c8-ad9b-b50cc2a563ca service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:27.836584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 715/1422] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:29.138545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65a0fc-73af-4c3d-9c95-8a24519d0325 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:29.139133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65a0fc-73af-4c3d-9c95-8a24519d0325 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:29.141024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65a0fc-73af-4c3d-9c95-8a24519d0325 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:29.142542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:56:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:29.148997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4352d-2730-4c8e-a51b-72aa865d5ec6 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:29.149495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4352d-2730-4c8e-a51b-72aa865d5ec6 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:29.149607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4352d-2730-4c8e-a51b-72aa865d5ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:29.169397 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-6cc4352d-2730-4c8e-a51b-72aa865d5ec6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:29.170651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6cc4352d-2730-4c8e-a51b-72aa865d5ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:29.179200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:29.336146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65a0fc-73af-4c3d-9c95-8a24519d0325 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:29.351036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65a0fc-73af-4c3d-9c95-8a24519d0325 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:29.356535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bb0a-c985-4fff-9cbc-86735571acce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:29.357136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bb0a-c985-4fff-9cbc-86735571acce service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:29.357449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bb0a-c985-4fff-9cbc-86735571acce service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:29.357729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bb0a-c985-4fff-9cbc-86735571acce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:29.367263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2bb0a-c985-4fff-9cbc-86735571acce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:29.369122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2bb0a-c985-4fff-9cbc-86735571acce service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:29.379638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 709/1425] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:30.689092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e27f-b045-4af8-93d9-9d7eafab35ac None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:30.689878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e27f-b045-4af8-93d9-9d7eafab35ac None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:30.689878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853e27f-b045-4af8-93d9-9d7eafab35ac None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:30.691231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:30.696413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34658-0fd7-4390-9992-1769eb490f4f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:30.696940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34658-0fd7-4390-9992-1769eb490f4f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:30.697056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34658-0fd7-4390-9992-1769eb490f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:30.715600 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-07f34658-0fd7-4390-9992-1769eb490f4f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:30.716796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-07f34658-0fd7-4390-9992-1769eb490f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:30.725707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:56:30.880171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853e27f-b045-4af8-93d9-9d7eafab35ac None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:30.895463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853e27f-b045-4af8-93d9-9d7eafab35ac None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:30.900902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ca711-67a8-415c-a842-bf16a54aae15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:30.910881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca711-67a8-415c-a842-bf16a54aae15 service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:30.910881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca711-67a8-415c-a842-bf16a54aae15 service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:30.910881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca711-67a8-415c-a842-bf16a54aae15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:30.911334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ca711-67a8-415c-a842-bf16a54aae15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:30.912914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ca711-67a8-415c-a842-bf16a54aae15 service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:30.922368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 718/1428] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:32.236679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893ae3-c282-4109-8fbc-79ccfaf519a0 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:32.237577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893ae3-c282-4109-8fbc-79ccfaf519a0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:32.237577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893ae3-c282-4109-8fbc-79ccfaf519a0 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:32.238666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:32.244030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7457789-2b67-47c1-9f90-4b037797b061 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:32.244478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7457789-2b67-47c1-9f90-4b037797b061 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:32.244583 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7457789-2b67-47c1-9f90-4b037797b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:32.263340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a7457789-2b67-47c1-9f90-4b037797b061 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:32.264541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a7457789-2b67-47c1-9f90-4b037797b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:32.274456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:32.427587 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4893ae3-c282-4109-8fbc-79ccfaf519a0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:32.442471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4893ae3-c282-4109-8fbc-79ccfaf519a0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:32.447784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623e0b9-df4c-449a-9591-e627d4af586e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:32.448418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e0b9-df4c-449a-9591-e627d4af586e service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:32.448697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e0b9-df4c-449a-9591-e627d4af586e service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:32.448970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623e0b9-df4c-449a-9591-e627d4af586e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:32.457343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623e0b9-df4c-449a-9591-e627d4af586e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:32.458923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623e0b9-df4c-449a-9591-e627d4af586e service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:32.468055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 712/1431] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:33.754258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a5dcd-08b3-4286-8307-9495fe812c39 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:33.754823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a5dcd-08b3-4286-8307-9495fe812c39 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:33.754823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a5dcd-08b3-4286-8307-9495fe812c39 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:33.756196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:33.761450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287e40-067a-43b1-a4a1-a2d08f501ed6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:33.761928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287e40-067a-43b1-a4a1-a2d08f501ed6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:33.762082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287e40-067a-43b1-a4a1-a2d08f501ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:33.780601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3d287e40-067a-43b1-a4a1-a2d08f501ed6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:33.781829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3d287e40-067a-43b1-a4a1-a2d08f501ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:33.789705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:33.938882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a5dcd-08b3-4286-8307-9495fe812c39 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:33.954684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a5dcd-08b3-4286-8307-9495fe812c39 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:33.960306 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99da4b8-d94d-41cd-8060-29f188a2e9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:33.960956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99da4b8-d94d-41cd-8060-29f188a2e9de service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:33.961266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99da4b8-d94d-41cd-8060-29f188a2e9de service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:33.961560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99da4b8-d94d-41cd-8060-29f188a2e9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:33.970057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99da4b8-d94d-41cd-8060-29f188a2e9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:33.971703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99da4b8-d94d-41cd-8060-29f188a2e9de service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:33.981287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 721/1434] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:35.277915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5c545-e0bd-4332-91c4-4e28f424f1a3 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:35.278460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5c545-e0bd-4332-91c4-4e28f424f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:35.278460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5c545-e0bd-4332-91c4-4e28f424f1a3 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:35.279903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:35.285890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b4fcf-86e0-4313-a97a-aa77ee1548ab None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:35.286345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b4fcf-86e0-4313-a97a-aa77ee1548ab None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:35.286468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b4fcf-86e0-4313-a97a-aa77ee1548ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:35.306477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-824b4fcf-86e0-4313-a97a-aa77ee1548ab None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:35.307692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-824b4fcf-86e0-4313-a97a-aa77ee1548ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:35.316101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:35.472570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5c545-e0bd-4332-91c4-4e28f424f1a3 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:35.486614 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5c545-e0bd-4332-91c4-4e28f424f1a3 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:35.491922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bb6b4-7d0e-432a-837b-f66c9ee61054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:35.492562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bb6b4-7d0e-432a-837b-f66c9ee61054 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:35.492842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bb6b4-7d0e-432a-837b-f66c9ee61054 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:35.493406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bb6b4-7d0e-432a-837b-f66c9ee61054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:35.501743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bb6b4-7d0e-432a-837b-f66c9ee61054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:35.503535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bb6b4-7d0e-432a-837b-f66c9ee61054 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:35.512618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 715/1437] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:56:36.814774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edbd2b-cfba-451a-ba41-e93b0f49345e None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:36.815984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edbd2b-cfba-451a-ba41-e93b0f49345e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:36.815984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edbd2b-cfba-451a-ba41-e93b0f49345e None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:36.816823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:36.822072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33473b8a-3e41-4174-8a0f-45b668051192 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:36.822544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33473b8a-3e41-4174-8a0f-45b668051192 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:36.822653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33473b8a-3e41-4174-8a0f-45b668051192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:36.842372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-33473b8a-3e41-4174-8a0f-45b668051192 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:36.843597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-33473b8a-3e41-4174-8a0f-45b668051192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:36.852173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:37.005669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edbd2b-cfba-451a-ba41-e93b0f49345e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:37.020201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edbd2b-cfba-451a-ba41-e93b0f49345e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:37.025437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29087837-8246-4129-a4ec-7722a2cba9e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:37.026087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29087837-8246-4129-a4ec-7722a2cba9e3 service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:37.026357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29087837-8246-4129-a4ec-7722a2cba9e3 service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:37.026632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29087837-8246-4129-a4ec-7722a2cba9e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:37.035070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29087837-8246-4129-a4ec-7722a2cba9e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:37.036645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29087837-8246-4129-a4ec-7722a2cba9e3 service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:37.045992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 724/1440] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:39.273219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72818-90f0-47d1-98d9-7153d5f753bf None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:39.273836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72818-90f0-47d1-98d9-7153d5f753bf None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:39.273836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72818-90f0-47d1-98d9-7153d5f753bf None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:39.275184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:39.280652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3a7c-51f2-4327-89dd-78da3d7c9276 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:39.281135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3a7c-51f2-4327-89dd-78da3d7c9276 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:39.281255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3a7c-51f2-4327-89dd-78da3d7c9276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:39.300213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-06bb3a7c-51f2-4327-89dd-78da3d7c9276 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:39.301462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-06bb3a7c-51f2-4327-89dd-78da3d7c9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:39.309408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:39.348988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72818-90f0-47d1-98d9-7153d5f753bf None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:39.359976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72818-90f0-47d1-98d9-7153d5f753bf None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:39.364237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46f605-2ed3-4018-8fbc-dbc02c283e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:39.364876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f605-2ed3-4018-8fbc-dbc02c283e11 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:39.365217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f605-2ed3-4018-8fbc-dbc02c283e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:39.365576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f605-2ed3-4018-8fbc-dbc02c283e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:39.375036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46f605-2ed3-4018-8fbc-dbc02c283e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:39.376539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46f605-2ed3-4018-8fbc-dbc02c283e11 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:39.386967 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 718/1443] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:41.825950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b189-2c30-46c4-9ec9-ddb68b82c781 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:41.826570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b189-2c30-46c4-9ec9-ddb68b82c781 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:41.826570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b189-2c30-46c4-9ec9-ddb68b82c781 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:41.827859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:41.833277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6554-80e4-4c1c-8ead-75cb4963bc9f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:41.833750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6554-80e4-4c1c-8ead-75cb4963bc9f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:41.833861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6554-80e4-4c1c-8ead-75cb4963bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:41.851916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-46ec6554-80e4-4c1c-8ead-75cb4963bc9f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:41.853101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-46ec6554-80e4-4c1c-8ead-75cb4963bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:41.861929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:56:41.899004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299b189-2c30-46c4-9ec9-ddb68b82c781 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:41.909879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299b189-2c30-46c4-9ec9-ddb68b82c781 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:41.913391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d6f32-1e12-4566-9d3b-da79c4f4eaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:41.914016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6f32-1e12-4566-9d3b-da79c4f4eaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:41.914294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6f32-1e12-4566-9d3b-da79c4f4eaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:41.914566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6f32-1e12-4566-9d3b-da79c4f4eaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:41.923298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d6f32-1e12-4566-9d3b-da79c4f4eaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:41.925629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d6f32-1e12-4566-9d3b-da79c4f4eaa9 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:41.934753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 727/1446] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:44.639452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37441429-96c6-4feb-b921-8350661b9ba2 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:44.640059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37441429-96c6-4feb-b921-8350661b9ba2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:44.640059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37441429-96c6-4feb-b921-8350661b9ba2 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:44.641387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:44.647623 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed55f90-81dc-432b-ba42-cffeb1ffa67e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:44.648106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed55f90-81dc-432b-ba42-cffeb1ffa67e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:44.648300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed55f90-81dc-432b-ba42-cffeb1ffa67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:44.666792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7ed55f90-81dc-432b-ba42-cffeb1ffa67e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:44.667983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7ed55f90-81dc-432b-ba42-cffeb1ffa67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:44.675857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:44.714707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37441429-96c6-4feb-b921-8350661b9ba2 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:44.725481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37441429-96c6-4feb-b921-8350661b9ba2 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:44.728898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc0dd4-ee1f-478b-bdc1-0db2b467cfc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:44.729564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0dd4-ee1f-478b-bdc1-0db2b467cfc1 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:44.729844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0dd4-ee1f-478b-bdc1-0db2b467cfc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:44.730118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc0dd4-ee1f-478b-bdc1-0db2b467cfc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:44.740151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc0dd4-ee1f-478b-bdc1-0db2b467cfc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:44.741149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc0dd4-ee1f-478b-bdc1-0db2b467cfc1 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:44.753392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 721/1449] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:47.198219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937ab8-7e36-4d6e-ad02-c136fc483efd None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:47.198779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937ab8-7e36-4d6e-ad02-c136fc483efd None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:47.198779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937ab8-7e36-4d6e-ad02-c136fc483efd None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:47.200137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:47.205692 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa381b3-28a4-4e15-94ae-237e08fb8a45 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:47.206170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa381b3-28a4-4e15-94ae-237e08fb8a45 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:47.206287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa381b3-28a4-4e15-94ae-237e08fb8a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:47.224399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-9aa381b3-28a4-4e15-94ae-237e08fb8a45 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:47.225628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9aa381b3-28a4-4e15-94ae-237e08fb8a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:47.233470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:47.272277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937ab8-7e36-4d6e-ad02-c136fc483efd None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:47.283409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937ab8-7e36-4d6e-ad02-c136fc483efd None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:47.287082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aa56f-eb57-4de5-b6de-dbb3e10ef170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:47.287713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa56f-eb57-4de5-b6de-dbb3e10ef170 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:47.287993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa56f-eb57-4de5-b6de-dbb3e10ef170 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:47.288268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa56f-eb57-4de5-b6de-dbb3e10ef170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:47.297017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aa56f-eb57-4de5-b6de-dbb3e10ef170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:47.299169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aa56f-eb57-4de5-b6de-dbb3e10ef170 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:47.308585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 730/1452] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:49.662097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f0b7-e9b2-4b09-b3fc-69088de907ac None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:49.662678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f0b7-e9b2-4b09-b3fc-69088de907ac None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:49.662678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f0b7-e9b2-4b09-b3fc-69088de907ac None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:49.664135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:49.669799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68882ad7-ea49-43c2-923c-59ba9a173777 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:49.670221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68882ad7-ea49-43c2-923c-59ba9a173777 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:49.670356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68882ad7-ea49-43c2-923c-59ba9a173777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:49.688045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-68882ad7-ea49-43c2-923c-59ba9a173777 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:49.689468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-68882ad7-ea49-43c2-923c-59ba9a173777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:49.697363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:49.737290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848f0b7-e9b2-4b09-b3fc-69088de907ac None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:49.748235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848f0b7-e9b2-4b09-b3fc-69088de907ac None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:49.752597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c910c-ca06-429a-a0b8-ac52cbb887a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:49.753400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c910c-ca06-429a-a0b8-ac52cbb887a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:49.753693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c910c-ca06-429a-a0b8-ac52cbb887a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:49.753998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c910c-ca06-429a-a0b8-ac52cbb887a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:49.763358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c910c-ca06-429a-a0b8-ac52cbb887a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:49.764790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c910c-ca06-429a-a0b8-ac52cbb887a4 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:49.775051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 724/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:52.161854 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503e0a2-9f54-4efb-b1c3-7598e677f59e None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:52.162421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503e0a2-9f54-4efb-b1c3-7598e677f59e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:52.162421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503e0a2-9f54-4efb-b1c3-7598e677f59e None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:52.163795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:52.169154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832b4a5-1eed-4678-a6ed-81b949701f6b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:52.169589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832b4a5-1eed-4678-a6ed-81b949701f6b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:52.169748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832b4a5-1eed-4678-a6ed-81b949701f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:52.188633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0832b4a5-1eed-4678-a6ed-81b949701f6b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:52.191005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0832b4a5-1eed-4678-a6ed-81b949701f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:52.198807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:52.238724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503e0a2-9f54-4efb-b1c3-7598e677f59e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:52.249331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503e0a2-9f54-4efb-b1c3-7598e677f59e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:52.253134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757aab6-ca74-44fb-b3f2-527b69d14858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:52.253861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757aab6-ca74-44fb-b3f2-527b69d14858 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:52.254153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757aab6-ca74-44fb-b3f2-527b69d14858 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:52.254432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757aab6-ca74-44fb-b3f2-527b69d14858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:52.263891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757aab6-ca74-44fb-b3f2-527b69d14858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:52.265453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757aab6-ca74-44fb-b3f2-527b69d14858 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:52.275325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 733/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:54.633945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502af9a-d7ed-4b84-9cd7-da110213a9d7 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:54.634518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502af9a-d7ed-4b84-9cd7-da110213a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:54.634518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502af9a-d7ed-4b84-9cd7-da110213a9d7 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:54.639747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:54.641175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2a9a-3a26-453f-adc3-fddc73a8f397 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:54.641655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2a9a-3a26-453f-adc3-fddc73a8f397 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:54.641775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f2a9a-3a26-453f-adc3-fddc73a8f397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:54.659831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d48f2a9a-3a26-453f-adc3-fddc73a8f397 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:54.661043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d48f2a9a-3a26-453f-adc3-fddc73a8f397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:54.668900 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:54.706857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502af9a-d7ed-4b84-9cd7-da110213a9d7 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:54.719636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502af9a-d7ed-4b84-9cd7-da110213a9d7 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:54.725267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08a3c0-4d06-4b84-ab73-65a6b0ac0f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:54.726042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a3c0-4d06-4b84-ab73-65a6b0ac0f8e service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:54.726328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a3c0-4d06-4b84-ab73-65a6b0ac0f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:54.726626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a3c0-4d06-4b84-ab73-65a6b0ac0f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:54.736735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08a3c0-4d06-4b84-ab73-65a6b0ac0f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:54.738203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08a3c0-4d06-4b84-ab73-65a6b0ac0f8e service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:54.750478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 727/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:57.068424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c72a-8133-4f52-b69f-79f4a4752ab8 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:57.068972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c72a-8133-4f52-b69f-79f4a4752ab8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:57.068972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c72a-8133-4f52-b69f-79f4a4752ab8 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:57.070384 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:57.075973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789192-19d3-4d19-b7c6-35541bdb2393 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:57.076438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789192-19d3-4d19-b7c6-35541bdb2393 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:57.076642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789192-19d3-4d19-b7c6-35541bdb2393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:57.094892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-fc789192-19d3-4d19-b7c6-35541bdb2393 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:57.096282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-fc789192-19d3-4d19-b7c6-35541bdb2393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:57.104134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:57.142899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c72a-8133-4f52-b69f-79f4a4752ab8 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:57.153433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c72a-8133-4f52-b69f-79f4a4752ab8 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:57.156869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546da226-a1b7-4fd5-b2e5-0ef6da1073f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:57.157543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546da226-a1b7-4fd5-b2e5-0ef6da1073f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:57.157845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546da226-a1b7-4fd5-b2e5-0ef6da1073f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:57.158305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546da226-a1b7-4fd5-b2e5-0ef6da1073f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:57.167488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546da226-a1b7-4fd5-b2e5-0ef6da1073f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:57.168909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546da226-a1b7-4fd5-b2e5-0ef6da1073f6 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:57.178846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 736/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:59.479818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968089-a453-4369-9ef1-d2e1ec4fdfb1 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:59.480334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968089-a453-4369-9ef1-d2e1ec4fdfb1 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:59.480334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968089-a453-4369-9ef1-d2e1ec4fdfb1 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:59.481715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:56:59.487125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71f56-125e-47c4-ba8d-3decf3c797ef None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:59.494114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71f56-125e-47c4-ba8d-3decf3c797ef None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:59.494114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71f56-125e-47c4-ba8d-3decf3c797ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:59.505746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3eb71f56-125e-47c4-ba8d-3decf3c797ef None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:59.506940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3eb71f56-125e-47c4-ba8d-3decf3c797ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:59.514799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:59.551808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968089-a453-4369-9ef1-d2e1ec4fdfb1 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:59.562333 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968089-a453-4369-9ef1-d2e1ec4fdfb1 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:59.565994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d98274-72b1-44a8-93e0-d2564ecdaf22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:59.566648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98274-72b1-44a8-93e0-d2564ecdaf22 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:59.566929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98274-72b1-44a8-93e0-d2564ecdaf22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:59.567202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98274-72b1-44a8-93e0-d2564ecdaf22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:59.577432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d98274-72b1-44a8-93e0-d2564ecdaf22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:59.578924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d98274-72b1-44a8-93e0-d2564ecdaf22 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:59.589189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 730/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:01.889185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e550-bc1c-4235-b57d-5ebbc9a66f05 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:01.889767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e550-bc1c-4235-b57d-5ebbc9a66f05 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:01.889767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e550-bc1c-4235-b57d-5ebbc9a66f05 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:01.891326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:01.897525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e31b-2f53-4b75-9492-1d620e96eef8 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:01.898088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e31b-2f53-4b75-9492-1d620e96eef8 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:01.898199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e31b-2f53-4b75-9492-1d620e96eef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:01.916313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4ef7e31b-2f53-4b75-9492-1d620e96eef8 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:01.917601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4ef7e31b-2f53-4b75-9492-1d620e96eef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:01.925425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:57:01.963461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1e550-bc1c-4235-b57d-5ebbc9a66f05 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:01.974379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1e550-bc1c-4235-b57d-5ebbc9a66f05 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:01.977996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361ccf3-5b51-401b-bc23-396443cd1199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:01.978628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361ccf3-5b51-401b-bc23-396443cd1199 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:01.978908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361ccf3-5b51-401b-bc23-396443cd1199 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:01.979183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361ccf3-5b51-401b-bc23-396443cd1199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:01.988274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361ccf3-5b51-401b-bc23-396443cd1199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:01.989725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361ccf3-5b51-401b-bc23-396443cd1199 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:01.999174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 739/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:36.534181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adde54-866b-4981-8610-0ced28d45df2 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:36.534830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adde54-866b-4981-8610-0ced28d45df2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:36.534830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adde54-866b-4981-8610-0ced28d45df2 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:36.536107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 732/1471] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:36.541362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d11b1d-8fe6-4c51-a87c-791d72220a44 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:36.541798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d11b1d-8fe6-4c51-a87c-791d72220a44 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:36.541903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d11b1d-8fe6-4c51-a87c-791d72220a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:36.560025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-48d11b1d-8fe6-4c51-a87c-791d72220a44 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:36.561216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-48d11b1d-8fe6-4c51-a87c-791d72220a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:36.569548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 740/1472] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:57:36.616680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134ba7-f098-4bf0-8a2d-3ba9ff6b1a30 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:36.616966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134ba7-f098-4bf0-8a2d-3ba9ff6b1a30 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:36.617263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134ba7-f098-4bf0-8a2d-3ba9ff6b1a30 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:36.618929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 733/1473] 10.222.0.69 () {54 vars in 962 bytes} [Wed May 4 13:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:36.623749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aac485-3d93-4fb3-933c-198912bbcd86 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:36.624041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aac485-3d93-4fb3-933c-198912bbcd86 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:36.624320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aac485-3d93-4fb3-933c-198912bbcd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:36.642952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-72aac485-3d93-4fb3-933c-198912bbcd86 None None] MFA Rules not processed for user `26d96159b7fb49c08b1f5c014d26f79b`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:36.644161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-72aac485-3d93-4fb3-933c-198912bbcd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:36.650904 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 741/1474] 10.222.0.69 () {58 vars in 1059 bytes} [Wed May 4 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:57:36.658964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37134ba7-f098-4bf0-8a2d-3ba9ff6b1a30 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:36.669280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37134ba7-f098-4bf0-8a2d-3ba9ff6b1a30 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:36.673378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3dfeb-a388-491a-b6a0-df321d344c08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d96159b7fb49c08b1f5c014d26f79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:36.674011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3dfeb-a388-491a-b6a0-df321d344c08 service glance] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:36.674287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3dfeb-a388-491a-b6a0-df321d344c08 service glance] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:36.674557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3dfeb-a388-491a-b6a0-df321d344c08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:36.683218 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3dfeb-a388-491a-b6a0-df321d344c08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:36.684639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3dfeb-a388-491a-b6a0-df321d344c08 service glance] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:36.694303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 734/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:39.059013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863147fd-fa29-4d6c-9080-3fe9dbdbcd21 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:39.059556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863147fd-fa29-4d6c-9080-3fe9dbdbcd21 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:39.059662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863147fd-fa29-4d6c-9080-3fe9dbdbcd21 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:39.060981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 742/1476] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:39.066742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cced7-d5c9-4479-a82f-9ddc23b00977 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:39.067210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cced7-d5c9-4479-a82f-9ddc23b00977 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:39.067326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cced7-d5c9-4479-a82f-9ddc23b00977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:39.086345 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e18cced7-d5c9-4479-a82f-9ddc23b00977 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:39.087553 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e18cced7-d5c9-4479-a82f-9ddc23b00977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:39.096189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 735/1477] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:57:39.120003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863147fd-fa29-4d6c-9080-3fe9dbdbcd21 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:39.133420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863147fd-fa29-4d6c-9080-3fe9dbdbcd21 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:39.138028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5d1b1-9d4c-40c2-82b9-fe143340024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:39.138673 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5d1b1-9d4c-40c2-82b9-fe143340024d admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:39.138952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5d1b1-9d4c-40c2-82b9-fe143340024d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:39.139225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5d1b1-9d4c-40c2-82b9-fe143340024d admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:39.139957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5d1b1-9d4c-40c2-82b9-fe143340024d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:39.142312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING py.warnings [None req-6dc5d1b1-9d4c-40c2-82b9-fe143340024d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:57:39.142312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: warnings.warn(msg) May 04 13:57:39.142312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: May 04 13:57:39.143440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5d1b1-9d4c-40c2-82b9-fe143340024d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:39.163789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 743/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Wed May 4 13:57:39 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:57:41.494069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c72e-90bc-40e8-8c77-1e2149e89b66 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:41.494682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c72e-90bc-40e8-8c77-1e2149e89b66 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:41.494682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c72e-90bc-40e8-8c77-1e2149e89b66 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:41.495915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 736/1479] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:41.501508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09682-5659-485f-8761-83be7877f965 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:41.501967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09682-5659-485f-8761-83be7877f965 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:41.502083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09682-5659-485f-8761-83be7877f965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:41.520216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-36d09682-5659-485f-8761-83be7877f965 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:41.521452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-36d09682-5659-485f-8761-83be7877f965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:41.529374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 744/1480] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:57:41.572162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c72e-90bc-40e8-8c77-1e2149e89b66 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:41.587164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c72e-90bc-40e8-8c77-1e2149e89b66 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:41.592782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944b48-5d18-40ed-8b53-bc428e03529a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:41.593453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944b48-5d18-40ed-8b53-bc428e03529a service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:41.593738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944b48-5d18-40ed-8b53-bc428e03529a service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:41.594719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944b48-5d18-40ed-8b53-bc428e03529a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:41.603046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36944b48-5d18-40ed-8b53-bc428e03529a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:41.604629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36944b48-5d18-40ed-8b53-bc428e03529a service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:41.614700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 737/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:44.086443 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a26af6-37c0-4a59-983e-4d2542be5444 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:44.086992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a26af6-37c0-4a59-983e-4d2542be5444 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:44.086992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a26af6-37c0-4a59-983e-4d2542be5444 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:44.088446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 745/1482] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:44.093630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c972e1-0ad9-4930-b442-954824256a0f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:44.094622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c972e1-0ad9-4930-b442-954824256a0f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:44.094852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c972e1-0ad9-4930-b442-954824256a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:44.112754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a3c972e1-0ad9-4930-b442-954824256a0f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:44.113978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a3c972e1-0ad9-4930-b442-954824256a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:44.121945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 738/1483] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:57:44.160832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a26af6-37c0-4a59-983e-4d2542be5444 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:44.171277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a26af6-37c0-4a59-983e-4d2542be5444 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:44.175827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a7a8-4ba5-4091-b2f5-8a810e083405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:44.176456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a7a8-4ba5-4091-b2f5-8a810e083405 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:44.176734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a7a8-4ba5-4091-b2f5-8a810e083405 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:44.177004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a7a8-4ba5-4091-b2f5-8a810e083405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:44.185650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83a7a8-4ba5-4091-b2f5-8a810e083405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:44.187058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83a7a8-4ba5-4091-b2f5-8a810e083405 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:44.196369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 746/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:46.520401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83355efd-d5a0-4cc8-975d-619b7fef704b None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:46.520984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83355efd-d5a0-4cc8-975d-619b7fef704b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:46.520984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83355efd-d5a0-4cc8-975d-619b7fef704b None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:46.522382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 739/1485] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:46.527826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40240391-b96c-4865-8e83-56612f3e0e17 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:46.528257 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40240391-b96c-4865-8e83-56612f3e0e17 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:46.528389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40240391-b96c-4865-8e83-56612f3e0e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:46.547029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-40240391-b96c-4865-8e83-56612f3e0e17 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:46.549379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-40240391-b96c-4865-8e83-56612f3e0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:46.557194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 747/1486] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:57:46.596509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83355efd-d5a0-4cc8-975d-619b7fef704b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:46.606990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83355efd-d5a0-4cc8-975d-619b7fef704b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:46.610523 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1527c9b-c263-4b86-98f0-f2d21dbc54d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:46.611146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1527c9b-c263-4b86-98f0-f2d21dbc54d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:46.611428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1527c9b-c263-4b86-98f0-f2d21dbc54d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:46.611693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1527c9b-c263-4b86-98f0-f2d21dbc54d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:46.620544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1527c9b-c263-4b86-98f0-f2d21dbc54d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:46.622011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1527c9b-c263-4b86-98f0-f2d21dbc54d2 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:46.631445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 740/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:49.080053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab5c3-0647-40ce-9046-35d3db3dfe60 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:49.080589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab5c3-0647-40ce-9046-35d3db3dfe60 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:49.080589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab5c3-0647-40ce-9046-35d3db3dfe60 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:49.081940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 748/1488] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:49.087153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a8e61-4c13-4655-8427-b36488552fd3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:49.087562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a8e61-4c13-4655-8427-b36488552fd3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:49.087702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a8e61-4c13-4655-8427-b36488552fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:49.105429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-805a8e61-4c13-4655-8427-b36488552fd3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:49.106737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-805a8e61-4c13-4655-8427-b36488552fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:49.115453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 741/1489] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:57:49.157690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ab5c3-0647-40ce-9046-35d3db3dfe60 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:49.168490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ab5c3-0647-40ce-9046-35d3db3dfe60 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:49.172576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b657c2-c48a-4c36-84e2-3df1bab98965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:49.173883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b657c2-c48a-4c36-84e2-3df1bab98965 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:49.174171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b657c2-c48a-4c36-84e2-3df1bab98965 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:49.174450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b657c2-c48a-4c36-84e2-3df1bab98965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:49.183487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b657c2-c48a-4c36-84e2-3df1bab98965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:49.184902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b657c2-c48a-4c36-84e2-3df1bab98965 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:49.195712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 749/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:51.931123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e5cf4-eff0-4001-8aaf-4708827599ee None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:51.931665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e5cf4-eff0-4001-8aaf-4708827599ee None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:51.931665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e5cf4-eff0-4001-8aaf-4708827599ee None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:51.933040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 742/1491] 10.222.0.69 () {54 vars in 926 bytes} [Wed May 4 13:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:57:51.939258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4466e2-f9c4-456f-96a5-9cf144bb07f6 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:51.939718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4466e2-f9c4-456f-96a5-9cf144bb07f6 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:51.939827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4466e2-f9c4-456f-96a5-9cf144bb07f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:51.957483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8f4466e2-f9c4-456f-96a5-9cf144bb07f6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:51.958665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8f4466e2-f9c4-456f-96a5-9cf144bb07f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:51.966325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 750/1492] 10.222.0.69 () {58 vars in 1023 bytes} [Wed May 4 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:57:52.005797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e5cf4-eff0-4001-8aaf-4708827599ee None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:52.017188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e5cf4-eff0-4001-8aaf-4708827599ee None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:52.020635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b53a-d921-4d9d-8d4a-31a55574b0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:52.021293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b53a-d921-4d9d-8d4a-31a55574b0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:52.021582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b53a-d921-4d9d-8d4a-31a55574b0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:52.021859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b53a-d921-4d9d-8d4a-31a55574b0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:52.030669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723b53a-d921-4d9d-8d4a-31a55574b0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:52.032730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723b53a-d921-4d9d-8d4a-31a55574b0a2 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:52.042081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 743/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:59:34.735866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9be9-8bba-4d9f-9850-9d88eea8fb8c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:34.736483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9be9-8bba-4d9f-9850-9d88eea8fb8c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:34.736483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9be9-8bba-4d9f-9850-9d88eea8fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:34.756246 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-de8a9be9-8bba-4d9f-9850-9d88eea8fb8c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:34.757469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-de8a9be9-8bba-4d9f-9850-9d88eea8fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:34.766139 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 751/1494] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:34.774236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd093bd-9716-429b-a73a-88020833848d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:34.774721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd093bd-9716-429b-a73a-88020833848d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:34.774840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd093bd-9716-429b-a73a-88020833848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:34.792804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3fd093bd-9716-429b-a73a-88020833848d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:34.794020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3fd093bd-9716-429b-a73a-88020833848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:34.801962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 744/1495] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:34.806637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9be9-8bba-4d9f-9850-9d88eea8fb8c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:34.816853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9be9-8bba-4d9f-9850-9d88eea8fb8c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:34.821310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:34.821961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:34.822237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:34.822509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:34.823229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:59:34.823526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:34.824531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING py.warnings [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 13:59:34.824531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: warnings.warn(msg) May 04 13:59:34.824531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: May 04 13:59:34.825412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:34.837098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 752/1496] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 13:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:59:34.845473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd093bd-9716-429b-a73a-88020833848d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:34.854388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd093bd-9716-429b-a73a-88020833848d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:34.858925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:34.859571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:34.859850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:34.860124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:34.860803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:34.862674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING py.warnings [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:59:34.862674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: warnings.warn(msg) May 04 13:59:34.862674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: May 04 13:59:34.863866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:35.000151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 745/1497] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 13:59:34 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:59:35.004245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:35.014648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e0cfb-d77b-4f71-9816-f519e122dda7 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:35.206400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:35.207070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:35.207352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:35.207631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:35.208365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:35.209414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING py.warnings [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:59:35.209414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: warnings.warn(msg) May 04 13:59:35.209414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: May 04 13:59:35.210612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:35.336778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 753/1498] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 13:59:35 2022] POST /identity/v3/users => generated 289 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:59:35.340959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:35.351210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85176e1a-a587-4eef-b097-aaea38779666 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:35.355771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:35.356452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:35.356737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:35.357531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:35.358310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:35.359326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING py.warnings [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 13:59:35.359326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: warnings.warn(msg) May 04 13:59:35.359326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: May 04 13:59:35.360229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:35.374022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 746/1499] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 13:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:59:35.379313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:35.389094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275df21-17f3-4769-a5d8-db17db702d0a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:35.393691 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b933432-4583-4668-a326-c3ae2274f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:35.394346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b933432-4583-4668-a326-c3ae2274f635 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:35.394629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b933432-4583-4668-a326-c3ae2274f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:35.394905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b933432-4583-4668-a326-c3ae2274f635 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:35.395632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b933432-4583-4668-a326-c3ae2274f635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:35.396644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING py.warnings [None req-4b933432-4583-4668-a326-c3ae2274f635 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 13:59:35.396644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: warnings.warn(msg) May 04 13:59:35.396644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: May 04 13:59:35.397591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b933432-4583-4668-a326-c3ae2274f635 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:35.411381 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 754/1500] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 13:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:59:35.415677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:35.426731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d39651-3299-44ac-9895-4918a3c61859 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:35.431200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:35.432084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:35.432364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:35.433621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] PATH_INFO: `/v3/projects/af28c5b0c17341deb8b11b04922cd448/users/10b4913c492d4bfa8690ffc9d615330e/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:35.448075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af28c5b0c17341deb8b11b04922cd448, user_id=10b4913c492d4bfa8690ffc9d615330e, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:35.449167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING py.warnings [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:59:35.449167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: warnings.warn(msg) May 04 13:59:35.449167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: May 04 13:59:35.451547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:35.548590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 747/1501] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 13:59:35 2022] PUT /identity/v3/projects/af28c5b0c17341deb8b11b04922cd448/users/10b4913c492d4bfa8690ffc9d615330e/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:59:35.559959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f51584-b51b-47fa-b789-587a6cf14bf0 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:35.560403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f51584-b51b-47fa-b789-587a6cf14bf0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:35.560851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f51584-b51b-47fa-b789-587a6cf14bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:35.587443 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d3f51584-b51b-47fa-b789-587a6cf14bf0 None None] MFA Rules not processed for user `10b4913c492d4bfa8690ffc9d615330e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:35.588699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d3f51584-b51b-47fa-b789-587a6cf14bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:35.653292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 755/1502] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 13:59:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:35.665086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:35.735148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998011f-a5d2-4cfe-8c5f-3db8c03045c8 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:35.740547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c343e-916b-4e04-9b65-1223e9bb32bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:35.741189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c343e-916b-4e04-9b65-1223e9bb32bb service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:35.741501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c343e-916b-4e04-9b65-1223e9bb32bb service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:35.741776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c343e-916b-4e04-9b65-1223e9bb32bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:35.750322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c343e-916b-4e04-9b65-1223e9bb32bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:35.751940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c343e-916b-4e04-9b65-1223e9bb32bb service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:35.761586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 748/1503] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:59:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:59:35.839789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7933f9c-261d-4fa3-af12-945508d87cd2 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:35.840220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7933f9c-261d-4fa3-af12-945508d87cd2 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:35.840315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7933f9c-261d-4fa3-af12-945508d87cd2 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:35.842295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 756/1504] 10.222.0.69 () {52 vars in 829 bytes} [Wed May 4 13:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:59:35.846004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c343e-916b-4e04-9b65-1223e9bb32bb service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:35.908990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c343e-916b-4e04-9b65-1223e9bb32bb service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:35.913770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:35.914637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:35.914919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:35.915290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] PATH_INFO: `/v3/users/10b4913c492d4bfa8690ffc9d615330e` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:35.916484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b4913c492d4bfa8690ffc9d615330e)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:35.917620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING py.warnings [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:59:35.917620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: warnings.warn(msg) May 04 13:59:35.917620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: May 04 13:59:35.918830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:36.164822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b4913c492d4bfa8690ffc9d615330e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:36.183048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b4913c492d4bfa8690ffc9d615330e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:36.183750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b4913c492d4bfa8690ffc9d615330e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:36.184465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b4913c492d4bfa8690ffc9d615330e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:36.249654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b4913c492d4bfa8690ffc9d615330e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:36.268542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 749/1505] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 13:59:35 2022] DELETE /identity/v3/users/10b4913c492d4bfa8690ffc9d615330e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:59:36.273104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141fad8-2552-4959-9613-a3ee5b0967e0 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:36.273428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141fad8-2552-4959-9613-a3ee5b0967e0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:36.273711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141fad8-2552-4959-9613-a3ee5b0967e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:36.290976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9141fad8-2552-4959-9613-a3ee5b0967e0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:36.292170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9141fad8-2552-4959-9613-a3ee5b0967e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:36.350497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 757/1506] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 13:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:36.360945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:36.362395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:36.418588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339885a0-9c91-4830-a6d7-218eda8b0c4d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:36.422189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9867-83b1-4ebf-adf5-4b7a86a6ea71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:36.422847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9867-83b1-4ebf-adf5-4b7a86a6ea71 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:36.423130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9867-83b1-4ebf-adf5-4b7a86a6ea71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:36.423406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9867-83b1-4ebf-adf5-4b7a86a6ea71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:36.432415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb9867-83b1-4ebf-adf5-4b7a86a6ea71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:36.433884 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb9867-83b1-4ebf-adf5-4b7a86a6ea71 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:36.443724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 750/1507] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 13:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:59:36.905505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141fad8-2552-4959-9613-a3ee5b0967e0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:36.906987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9141fad8-2552-4959-9613-a3ee5b0967e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:36.920845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141fad8-2552-4959-9613-a3ee5b0967e0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:36.926340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:36.927220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:36.927537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:36.927862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] PATH_INFO: `/v3/projects/af28c5b0c17341deb8b11b04922cd448` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:36.929993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af28c5b0c17341deb8b11b04922cd448)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:36.931036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING py.warnings [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:59:36.931036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: warnings.warn(msg) May 04 13:59:36.931036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: May 04 13:59:36.932284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:37.048055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af28c5b0c17341deb8b11b04922cd448', 'request_id': 'req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:37.146690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af28c5b0c17341deb8b11b04922cd448', 'request_id': 'req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:37.153170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af28c5b0c17341deb8b11b04922cd448', 'request_id': 'req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:37.171354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] The token cache is being invalidate because project af28c5b0c17341deb8b11b04922cd448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:59:37.171568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:37.172226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-6d62ece3-dd5f-46d8-98ee-c2f832bdb64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:37.173917 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 758/1508] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 13:59:36 2022] DELETE /identity/v3/projects/af28c5b0c17341deb8b11b04922cd448 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:01:23.176068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d2a5-03ca-4413-af7b-4bb5c2a4eba9 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:23.176720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d2a5-03ca-4413-af7b-4bb5c2a4eba9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:23.176720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05d2a5-03ca-4413-af7b-4bb5c2a4eba9 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:23.178126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 751/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:23.183610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce735-f20b-454b-af0c-78ce76ab8cfd None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:23.184219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce735-f20b-454b-af0c-78ce76ab8cfd None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:23.184219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce735-f20b-454b-af0c-78ce76ab8cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:23.205660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-523ce735-f20b-454b-af0c-78ce76ab8cfd None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:23.206902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-523ce735-f20b-454b-af0c-78ce76ab8cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:23.270409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 759/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:23.427190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05d2a5-03ca-4413-af7b-4bb5c2a4eba9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:23.428787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5d05d2a5-03ca-4413-af7b-4bb5c2a4eba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:23.482270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0693db-4e3b-46b2-a5a9-ef6ccc6db0b8 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:23.482772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0693db-4e3b-46b2-a5a9-ef6ccc6db0b8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:23.483169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0693db-4e3b-46b2-a5a9-ef6ccc6db0b8 None None] PATH_INFO: `/v3` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:23.484488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 760/1511] 10.222.0.58 () {54 vars in 925 bytes} [Wed May 4 14:01:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:01:23.491531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986185cf-cdac-4c09-a6c4-ac9a9267d9d1 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:23.491813 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986185cf-cdac-4c09-a6c4-ac9a9267d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:23.496871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986185cf-cdac-4c09-a6c4-ac9a9267d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:23.505360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05d2a5-03ca-4413-af7b-4bb5c2a4eba9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:23.510711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-986185cf-cdac-4c09-a6c4-ac9a9267d9d1 None None] MFA Rules not processed for user `06ffd2170c2243eab4511fced8d67ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:23.511034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3799-29f4-4db4-8891-31cf6a792067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:23.511682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3799-29f4-4db4-8891-31cf6a792067 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:23.511960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3799-29f4-4db4-8891-31cf6a792067 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:23.512069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-986185cf-cdac-4c09-a6c4-ac9a9267d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:23.512231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3799-29f4-4db4-8891-31cf6a792067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:23.521485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e3799-29f4-4db4-8891-31cf6a792067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:23.523073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e3799-29f4-4db4-8891-31cf6a792067 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:23.533566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 752/1512] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:01:23.574707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 761/1513] 10.222.0.58 () {58 vars in 1015 bytes} [Wed May 4 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:01:24.806230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953391-7f75-436d-a418-f2ecefeee34e None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:24.806791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953391-7f75-436d-a418-f2ecefeee34e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:24.806791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953391-7f75-436d-a418-f2ecefeee34e None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:24.808179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:24.813129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6873d24-9fc9-4ffa-b7b8-dbc8e9301bbc None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:24.813637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6873d24-9fc9-4ffa-b7b8-dbc8e9301bbc None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:24.813752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6873d24-9fc9-4ffa-b7b8-dbc8e9301bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:24.831276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a6873d24-9fc9-4ffa-b7b8-dbc8e9301bbc None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:24.832462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a6873d24-9fc9-4ffa-b7b8-dbc8e9301bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:24.840051 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:24.992020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7953391-7f75-436d-a418-f2ecefeee34e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:25.008816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7953391-7f75-436d-a418-f2ecefeee34e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:25.015703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e02f0-a47c-4fc3-8e6c-f93094c1d93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:25.016415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e02f0-a47c-4fc3-8e6c-f93094c1d93e service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:25.016749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e02f0-a47c-4fc3-8e6c-f93094c1d93e service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:25.017069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e02f0-a47c-4fc3-8e6c-f93094c1d93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:25.026460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e02f0-a47c-4fc3-8e6c-f93094c1d93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:25.028238 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e02f0-a47c-4fc3-8e6c-f93094c1d93e service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:25.039880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 754/1516] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:01:32.742596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a9a3-30f4-4f27-b037-cdd459046c03 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:32.743124 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a9a3-30f4-4f27-b037-cdd459046c03 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:32.743124 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a9a3-30f4-4f27-b037-cdd459046c03 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:32.744487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 763/1517] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 14:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:32.750466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec64ef-f6a9-4fd7-97dc-a120b1b68b75 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:32.750939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec64ef-f6a9-4fd7-97dc-a120b1b68b75 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:32.751050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec64ef-f6a9-4fd7-97dc-a120b1b68b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:32.769505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-04ec64ef-f6a9-4fd7-97dc-a120b1b68b75 None None] MFA Rules not processed for user `06ffd2170c2243eab4511fced8d67ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:32.770727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-04ec64ef-f6a9-4fd7-97dc-a120b1b68b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:32.779903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 755/1518] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:32.787731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358a9a3-30f4-4f27-b037-cdd459046c03 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:32.801333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358a9a3-30f4-4f27-b037-cdd459046c03 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:32.806207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df00c7-1737-48a5-bfee-a4f5a9bd1f0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ffd2170c2243eab4511fced8d67ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:32.806867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df00c7-1737-48a5-bfee-a4f5a9bd1f0b service placement] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:32.807151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df00c7-1737-48a5-bfee-a4f5a9bd1f0b service placement] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:32.807428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df00c7-1737-48a5-bfee-a4f5a9bd1f0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:32.816554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df00c7-1737-48a5-bfee-a4f5a9bd1f0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:32.818161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df00c7-1737-48a5-bfee-a4f5a9bd1f0b service placement] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:32.828330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 764/1519] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:01:36.738414 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8e80a-5a9f-4cff-b382-edf9c8de9801 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:36.738999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8e80a-5a9f-4cff-b382-edf9c8de9801 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:36.738999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8e80a-5a9f-4cff-b382-edf9c8de9801 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:36.740374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 756/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:36.745352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340018c2-8abf-4766-867c-6a352f05c04a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:36.745814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340018c2-8abf-4766-867c-6a352f05c04a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:36.745928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340018c2-8abf-4766-867c-6a352f05c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:36.765265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-340018c2-8abf-4766-867c-6a352f05c04a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:36.766462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-340018c2-8abf-4766-867c-6a352f05c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:36.774223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 765/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:36.929717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8e80a-5a9f-4cff-b382-edf9c8de9801 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:36.945204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8e80a-5a9f-4cff-b382-edf9c8de9801 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:36.950743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433588ce-9280-46ba-b4bf-5ae4c18a4056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:36.951511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433588ce-9280-46ba-b4bf-5ae4c18a4056 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:36.951790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433588ce-9280-46ba-b4bf-5ae4c18a4056 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:36.952068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433588ce-9280-46ba-b4bf-5ae4c18a4056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:36.960682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433588ce-9280-46ba-b4bf-5ae4c18a4056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:36.962347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433588ce-9280-46ba-b4bf-5ae4c18a4056 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:36.971904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 757/1522] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:01:38.210971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9320-6bec-49ce-b95e-2991ff7c8c42 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:38.211530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9320-6bec-49ce-b95e-2991ff7c8c42 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:38.211702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9320-6bec-49ce-b95e-2991ff7c8c42 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:38.213076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 766/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 14:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:38.218623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cec98-8315-47ec-89b9-d32c615ff1bd None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:38.219599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cec98-8315-47ec-89b9-d32c615ff1bd None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:38.219599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cec98-8315-47ec-89b9-d32c615ff1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:38.237832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-513cec98-8315-47ec-89b9-d32c615ff1bd None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:38.239046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-513cec98-8315-47ec-89b9-d32c615ff1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:38.247454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 758/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:38.405016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9320-6bec-49ce-b95e-2991ff7c8c42 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:38.419388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9320-6bec-49ce-b95e-2991ff7c8c42 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:38.425427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893dcdc-a793-4858-a620-9fedc5672eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:38.426125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dcdc-a793-4858-a620-9fedc5672eea service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:38.426409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dcdc-a793-4858-a620-9fedc5672eea service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:38.426696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dcdc-a793-4858-a620-9fedc5672eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:38.436127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893dcdc-a793-4858-a620-9fedc5672eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:38.437759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893dcdc-a793-4858-a620-9fedc5672eea service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:38.447826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 767/1525] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:01:42.826450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366aee-bfda-4642-a2ba-5f3431b0f67b None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:42.827096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366aee-bfda-4642-a2ba-5f3431b0f67b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:42.827096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366aee-bfda-4642-a2ba-5f3431b0f67b None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:42.828483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 759/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:42.834658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba3f44-8998-4719-9028-86c5d5a1cdc1 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:42.835245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba3f44-8998-4719-9028-86c5d5a1cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:42.835245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba3f44-8998-4719-9028-86c5d5a1cdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:42.855968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-68ba3f44-8998-4719-9028-86c5d5a1cdc1 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:42.858953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-68ba3f44-8998-4719-9028-86c5d5a1cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:42.869103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 768/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:42.908093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366aee-bfda-4642-a2ba-5f3431b0f67b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:42.909919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-29366aee-bfda-4642-a2ba-5f3431b0f67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:42.973996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366aee-bfda-4642-a2ba-5f3431b0f67b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:42.977704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128288f-d569-4a29-bbb9-bc64ff69aeea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:42.978368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128288f-d569-4a29-bbb9-bc64ff69aeea service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:42.978646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128288f-d569-4a29-bbb9-bc64ff69aeea service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:42.978914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128288f-d569-4a29-bbb9-bc64ff69aeea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:42.992225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128288f-d569-4a29-bbb9-bc64ff69aeea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:42.994266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128288f-d569-4a29-bbb9-bc64ff69aeea service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:43.006688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 760/1528] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:01:45.484725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26554c0-f209-4212-a7f5-14b6352e6e4b None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:45.485387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26554c0-f209-4212-a7f5-14b6352e6e4b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:45.485387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26554c0-f209-4212-a7f5-14b6352e6e4b None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:45.486791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 769/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:45.492415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46bd37-0544-4377-ab12-362c46f28f02 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:45.493767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46bd37-0544-4377-ab12-362c46f28f02 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:45.493767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46bd37-0544-4377-ab12-362c46f28f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:45.516387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-8b46bd37-0544-4377-ab12-362c46f28f02 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:45.517815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-8b46bd37-0544-4377-ab12-362c46f28f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:45.526855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 761/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:45.565883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26554c0-f209-4212-a7f5-14b6352e6e4b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:45.579684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26554c0-f209-4212-a7f5-14b6352e6e4b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:45.583363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0be355-19b3-40a7-b951-bdf789384a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:45.584016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be355-19b3-40a7-b951-bdf789384a32 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:45.584303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be355-19b3-40a7-b951-bdf789384a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:45.584577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be355-19b3-40a7-b951-bdf789384a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:45.596597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0be355-19b3-40a7-b951-bdf789384a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:45.598082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0be355-19b3-40a7-b951-bdf789384a32 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:45.611608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 770/1531] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:01:49.687722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872dad-181a-4d88-b652-2c3bef1157fe None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:49.688334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872dad-181a-4d88-b652-2c3bef1157fe None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:49.688517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872dad-181a-4d88-b652-2c3bef1157fe None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:49.690315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 762/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:01:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:01:49.695739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd9bb-0918-41e7-8290-c3c7aedb0b35 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:49.696349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd9bb-0918-41e7-8290-c3c7aedb0b35 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:49.696349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd9bb-0918-41e7-8290-c3c7aedb0b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:49.715543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a93fd9bb-0918-41e7-8290-c3c7aedb0b35 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:49.716788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a93fd9bb-0918-41e7-8290-c3c7aedb0b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:49.725622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 771/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:50.027757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be872dad-181a-4d88-b652-2c3bef1157fe None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:50.031063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-be872dad-181a-4d88-b652-2c3bef1157fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:50.097360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be872dad-181a-4d88-b652-2c3bef1157fe None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:50.103011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761916ec-4894-4993-af23-bf1f102ab2dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:50.104073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761916ec-4894-4993-af23-bf1f102ab2dc service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:50.104507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761916ec-4894-4993-af23-bf1f102ab2dc service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:50.105004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761916ec-4894-4993-af23-bf1f102ab2dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:50.121064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761916ec-4894-4993-af23-bf1f102ab2dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:50.123676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761916ec-4894-4993-af23-bf1f102ab2dc service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:50.139948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 763/1534] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:01:52.570235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7097b-fa8f-4ff5-b435-20e4e926d53d None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:52.570913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7097b-fa8f-4ff5-b435-20e4e926d53d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:52.570913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7097b-fa8f-4ff5-b435-20e4e926d53d None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:52.572167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 772/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 14:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:52.578344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad84ca-9544-4663-a97c-2654676c0c2f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:52.578854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad84ca-9544-4663-a97c-2654676c0c2f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:52.578952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad84ca-9544-4663-a97c-2654676c0c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:52.598402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6bad84ca-9544-4663-a97c-2654676c0c2f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:52.599613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6bad84ca-9544-4663-a97c-2654676c0c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:52.608283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 764/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:52.886054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a95e-7f2e-4527-a99b-7a8d91349d09 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:52.886350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a95e-7f2e-4527-a99b-7a8d91349d09 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:52.886636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a95e-7f2e-4527-a99b-7a8d91349d09 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:52.888007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 773/1537] 10.222.0.69 () {54 vars in 963 bytes} [Wed May 4 14:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:01:52.893384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3cec-0166-4b2e-81cf-011c596a1344 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:52.893691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3cec-0166-4b2e-81cf-011c596a1344 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:52.893968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3cec-0166-4b2e-81cf-011c596a1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:52.914451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ff8c3cec-0166-4b2e-81cf-011c596a1344 None None] MFA Rules not processed for user `ec9c893558b74cf89012a50734d06ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:52.915651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ff8c3cec-0166-4b2e-81cf-011c596a1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:52.922469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 765/1538] 10.222.0.69 () {58 vars in 1060 bytes} [Wed May 4 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:52.930549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a95e-7f2e-4527-a99b-7a8d91349d09 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:52.942716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a95e-7f2e-4527-a99b-7a8d91349d09 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:52.947323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941748-ed3a-4dd2-b946-d670eb0e7934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:52.947626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941748-ed3a-4dd2-b946-d670eb0e7934 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:52.947905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941748-ed3a-4dd2-b946-d670eb0e7934 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:52.948175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941748-ed3a-4dd2-b946-d670eb0e7934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:52.959340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d941748-ed3a-4dd2-b946-d670eb0e7934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:52.960823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d941748-ed3a-4dd2-b946-d670eb0e7934 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:52.972839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 774/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:24.114422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6063-9851-4a35-a8a8-69237e8e90df None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.115110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6063-9851-4a35-a8a8-69237e8e90df None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.115110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6063-9851-4a35-a8a8-69237e8e90df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.145844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-769a6063-9851-4a35-a8a8-69237e8e90df None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.147069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-769a6063-9851-4a35-a8a8-69237e8e90df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.158925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 766/1540] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.170176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea40693-80a7-4f8f-a174-d9287c2201a3 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.171425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea40693-80a7-4f8f-a174-d9287c2201a3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.171949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea40693-80a7-4f8f-a174-d9287c2201a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.201163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3ea40693-80a7-4f8f-a174-d9287c2201a3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.202937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3ea40693-80a7-4f8f-a174-d9287c2201a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.224314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 775/1541] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.229458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6063-9851-4a35-a8a8-69237e8e90df None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.248036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6063-9851-4a35-a8a8-69237e8e90df None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.258039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e7872-e004-4efa-9523-55207d7d4a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.258745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7872-e004-4efa-9523-55207d7d4a2a admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.259032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7872-e004-4efa-9523-55207d7d4a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.259307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e7872-e004-4efa-9523-55207d7d4a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.260284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7872-e004-4efa-9523-55207d7d4a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:24.260628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7872-e004-4efa-9523-55207d7d4a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.261688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING py.warnings [None req-d55e7872-e004-4efa-9523-55207d7d4a2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 14:03:24.261688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: warnings.warn(msg) May 04 14:03:24.261688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: May 04 14:03:24.262597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e7872-e004-4efa-9523-55207d7d4a2a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.289681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 767/1542] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:24.308793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea40693-80a7-4f8f-a174-d9287c2201a3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.320067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea40693-80a7-4f8f-a174-d9287c2201a3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.333763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2388f3-12b0-4bb2-814d-e42abd3034c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.334859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2388f3-12b0-4bb2-814d-e42abd3034c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.335310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb9f8-fa2c-4c14-9c4e-d2156eea0ca4 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.335519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2388f3-12b0-4bb2-814d-e42abd3034c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.335907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2388f3-12b0-4bb2-814d-e42abd3034c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.336628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb9f8-fa2c-4c14-9c4e-d2156eea0ca4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.337273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2388f3-12b0-4bb2-814d-e42abd3034c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.337765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb9f8-fa2c-4c14-9c4e-d2156eea0ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.341267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING py.warnings [None req-8a2388f3-12b0-4bb2-814d-e42abd3034c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:03:24.341267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: warnings.warn(msg) May 04 14:03:24.341267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: May 04 14:03:24.341267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2388f3-12b0-4bb2-814d-e42abd3034c7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.403125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-7f8eb9f8-fa2c-4c14-9c4e-d2156eea0ca4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.406322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7f8eb9f8-fa2c-4c14-9c4e-d2156eea0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.424139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 768/1543] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 04 14:03:24.435664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68ec3-ac30-45b5-8beb-1d3abc1b11ea None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.436476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68ec3-ac30-45b5-8beb-1d3abc1b11ea None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.436987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c68ec3-ac30-45b5-8beb-1d3abc1b11ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.460644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-f1c68ec3-ac30-45b5-8beb-1d3abc1b11ea None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.462308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f1c68ec3-ac30-45b5-8beb-1d3abc1b11ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.468077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 776/1544] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:03:24.469491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a608-13c4-4416-b385-df405dfb1f77 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.469897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a608-13c4-4416-b385-df405dfb1f77 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.470240 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a608-13c4-4416-b385-df405dfb1f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.501758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f540a608-13c4-4416-b385-df405dfb1f77 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.503216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f540a608-13c4-4416-b385-df405dfb1f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.612283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 769/1545] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:03:24.613651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c68ec3-ac30-45b5-8beb-1d3abc1b11ea None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.629509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c68ec3-ac30-45b5-8beb-1d3abc1b11ea None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.634470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 777/1546] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.635346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277d66b-5066-4f1c-b9a6-71fbcd7bb03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.635920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0ccf-d375-4e5b-b0ef-8c04d699cda6 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.636299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0ccf-d375-4e5b-b0ef-8c04d699cda6 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.636771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0ccf-d375-4e5b-b0ef-8c04d699cda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.644037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d66b-5066-4f1c-b9a6-71fbcd7bb03d admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.644476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d66b-5066-4f1c-b9a6-71fbcd7bb03d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.644877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277d66b-5066-4f1c-b9a6-71fbcd7bb03d admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.645636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277d66b-5066-4f1c-b9a6-71fbcd7bb03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.646816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING py.warnings [None req-6277d66b-5066-4f1c-b9a6-71fbcd7bb03d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:03:24.646816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: warnings.warn(msg) May 04 14:03:24.646816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: May 04 14:03:24.648339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277d66b-5066-4f1c-b9a6-71fbcd7bb03d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.664076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9a1a0ccf-d375-4e5b-b0ef-8c04d699cda6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.665873 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9a1a0ccf-d375-4e5b-b0ef-8c04d699cda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.676057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 778/1547] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.677435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0782a5a-7a92-496a-85b7-7482c8a84cd6 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.677723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0782a5a-7a92-496a-85b7-7482c8a84cd6 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.678000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0782a5a-7a92-496a-85b7-7482c8a84cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.703483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a0782a5a-7a92-496a-85b7-7482c8a84cd6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.704667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a0782a5a-7a92-496a-85b7-7482c8a84cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.712528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 779/1548] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.713792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f614-0a9c-42e7-9ddc-28194187e5f3 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.714075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f614-0a9c-42e7-9ddc-28194187e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.714345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f614-0a9c-42e7-9ddc-28194187e5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.732358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-6929f614-0a9c-42e7-9ddc-28194187e5f3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.735235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6929f614-0a9c-42e7-9ddc-28194187e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.744558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 780/1549] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.744558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929f614-0a9c-42e7-9ddc-28194187e5f3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.755663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929f614-0a9c-42e7-9ddc-28194187e5f3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.766122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab54d51-1895-4b23-bd62-0f54df7a2fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.766122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54d51-1895-4b23-bd62-0f54df7a2fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.766122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54d51-1895-4b23-bd62-0f54df7a2fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.766122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54d51-1895-4b23-bd62-0f54df7a2fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.766752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab54d51-1895-4b23-bd62-0f54df7a2fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:24.766752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab54d51-1895-4b23-bd62-0f54df7a2fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.766752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab54d51-1895-4b23-bd62-0f54df7a2fd3 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.773353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 770/1550] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:24.773353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac00fa-ae23-43eb-8a2b-3a763cfd9c70 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.773353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac00fa-ae23-43eb-8a2b-3a763cfd9c70 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.773353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac00fa-ae23-43eb-8a2b-3a763cfd9c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.779279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 781/1551] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:24.780647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecee62-626b-4d99-a2ca-c4b80db829fb None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.780937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecee62-626b-4d99-a2ca-c4b80db829fb None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.781216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecee62-626b-4d99-a2ca-c4b80db829fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.798263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e8ac00fa-ae23-43eb-8a2b-3a763cfd9c70 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.799541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e8ac00fa-ae23-43eb-8a2b-3a763cfd9c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.800333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-40ecee62-626b-4d99-a2ca-c4b80db829fb None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.801540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-40ecee62-626b-4d99-a2ca-c4b80db829fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.807867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 771/1552] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.809105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334545-eaa5-4261-92e6-d440e8b80057 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.810005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 782/1553] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.810204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334545-eaa5-4261-92e6-d440e8b80057 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.810684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334545-eaa5-4261-92e6-d440e8b80057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.811518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037f44-8906-4d16-8bbe-adfbeb7948e8 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.811808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037f44-8906-4d16-8bbe-adfbeb7948e8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.812174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93037f44-8906-4d16-8bbe-adfbeb7948e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.831523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-93037f44-8906-4d16-8bbe-adfbeb7948e8 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.831945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-7f334545-eaa5-4261-92e6-d440e8b80057 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.832756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-93037f44-8906-4d16-8bbe-adfbeb7948e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.833352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7f334545-eaa5-4261-92e6-d440e8b80057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.843028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 772/1555] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.843240 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 783/1555] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.843737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037f44-8906-4d16-8bbe-adfbeb7948e8 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.844221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6efca-e99b-40e8-b2cb-b9be4dae4775 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.844512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6efca-e99b-40e8-b2cb-b9be4dae4775 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.844788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6efca-e99b-40e8-b2cb-b9be4dae4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.853376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93037f44-8906-4d16-8bbe-adfbeb7948e8 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.859177 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a0abe-b94e-41bb-b4b9-37a837cfaa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.859890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a0abe-b94e-41bb-b4b9-37a837cfaa72 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.860139 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a0abe-b94e-41bb-b4b9-37a837cfaa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.860417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a0abe-b94e-41bb-b4b9-37a837cfaa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.861153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a0abe-b94e-41bb-b4b9-37a837cfaa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.862784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a0abe-b94e-41bb-b4b9-37a837cfaa72 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.864565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-9ed6efca-e99b-40e8-b2cb-b9be4dae4775 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.865783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9ed6efca-e99b-40e8-b2cb-b9be4dae4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.873227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 784/1556] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:24.874394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 773/1557] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.875043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6efca-e99b-40e8-b2cb-b9be4dae4775 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.878298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467021-3ed2-4b51-ae18-78d096f189f6 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.878628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467021-3ed2-4b51-ae18-78d096f189f6 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.885125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71467021-3ed2-4b51-ae18-78d096f189f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.885289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6efca-e99b-40e8-b2cb-b9be4dae4775 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.890162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895dbb8-e9cf-40bc-aff6-178311a8ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.890817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dbb8-e9cf-40bc-aff6-178311a8ed49 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.891096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dbb8-e9cf-40bc-aff6-178311a8ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.891367 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dbb8-e9cf-40bc-aff6-178311a8ed49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.892053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895dbb8-e9cf-40bc-aff6-178311a8ed49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.893981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895dbb8-e9cf-40bc-aff6-178311a8ed49 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.897977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-71467021-3ed2-4b51-ae18-78d096f189f6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:24.899181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-71467021-3ed2-4b51-ae18-78d096f189f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:24.907848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 785/1558] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:24.908679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71467021-3ed2-4b51-ae18-78d096f189f6 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.918740 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71467021-3ed2-4b51-ae18-78d096f189f6 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.923891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.924548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.924832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.925113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.925879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:24.926186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.927778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.939985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 786/1559] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:24.941541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.951064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0315557-1be7-4210-b220-a015af115e4f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.955632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.956245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.956528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.956806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.957568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:24.957877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.959452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.971230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 787/1560] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:24.972172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:24.981954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4342629-728a-4c28-bde2-fe34ea3bdd8a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:24.986739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:24.987377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:24.987660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:24.987937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:24.988654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:24.988963 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:24.990578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:24.998518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 774/1561] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:25.000397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fbc60-f6d5-4f4d-bc7b-7eab20518edd None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.000874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fbc60-f6d5-4f4d-bc7b-7eab20518edd None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.001155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fbc60-f6d5-4f4d-bc7b-7eab20518edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.003623 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 788/1562] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:25.006406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.016919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49788a52-c65e-488f-97b5-fb1db72b8942 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.019886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-079fbc60-f6d5-4f4d-bc7b-7eab20518edd None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:25.022940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-079fbc60-f6d5-4f4d-bc7b-7eab20518edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:25.072586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b628680-dba4-4401-909f-39baeac25be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.073281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b628680-dba4-4401-909f-39baeac25be8 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.073571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b628680-dba4-4401-909f-39baeac25be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.073849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b628680-dba4-4401-909f-39baeac25be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.074589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b628680-dba4-4401-909f-39baeac25be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.076762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b628680-dba4-4401-909f-39baeac25be8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.079109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 775/1563] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:25.080275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fbc60-f6d5-4f4d-bc7b-7eab20518edd None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.086938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 789/1564] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:25.088346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a662-a2cf-400d-a848-045832c52e74 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.088641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a662-a2cf-400d-a848-045832c52e74 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.088922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741a662-a2cf-400d-a848-045832c52e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.094850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fbc60-f6d5-4f4d-bc7b-7eab20518edd None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.099419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.100082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.100367 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.100643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.101409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:25.101718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.103324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.107308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f741a662-a2cf-400d-a848-045832c52e74 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:25.108529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f741a662-a2cf-400d-a848-045832c52e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:25.115606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 776/1565] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:25.116629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.116766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 790/1566] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:25.117341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741a662-a2cf-400d-a848-045832c52e74 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.127181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741a662-a2cf-400d-a848-045832c52e74 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.131794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020bfd0-0a71-4101-b086-1f873fc60d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.132539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bfd0-0a71-4101-b086-1f873fc60d99 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.132897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bfd0-0a71-4101-b086-1f873fc60d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.133183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bfd0-0a71-4101-b086-1f873fc60d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.133944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020bfd0-0a71-4101-b086-1f873fc60d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.135853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020bfd0-0a71-4101-b086-1f873fc60d99 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.136261 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f1a-adef-4631-bff2-a3246cf128e7 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.141434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d7f2-15da-460a-b4a6-714a133fa2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.142089 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d7f2-15da-460a-b4a6-714a133fa2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.142367 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d7f2-15da-460a-b4a6-714a133fa2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.142643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3d7f2-15da-460a-b4a6-714a133fa2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.143354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d7f2-15da-460a-b4a6-714a133fa2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.145313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3d7f2-15da-460a-b4a6-714a133fa2c3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.245298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 791/1567] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:25.245938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020bfd0-0a71-4101-b086-1f873fc60d99 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.298095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 777/1568] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:25.298946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d7f2-15da-460a-b4a6-714a133fa2c3 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.310902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020bfd0-0a71-4101-b086-1f873fc60d99 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.366859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3d7f2-15da-460a-b4a6-714a133fa2c3 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.368907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf717e7-e5ef-40f8-97ff-f0545eafabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.369602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf717e7-e5ef-40f8-97ff-f0545eafabd9 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.369894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf717e7-e5ef-40f8-97ff-f0545eafabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.370175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf717e7-e5ef-40f8-97ff-f0545eafabd9 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.371554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf717e7-e5ef-40f8-97ff-f0545eafabd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.371677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fcb41-d44d-448a-9cc5-9ef829edb62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.372532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fcb41-d44d-448a-9cc5-9ef829edb62d admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.372826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fcb41-d44d-448a-9cc5-9ef829edb62d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.373325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fcb41-d44d-448a-9cc5-9ef829edb62d admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.373843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf717e7-e5ef-40f8-97ff-f0545eafabd9 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.374305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fcb41-d44d-448a-9cc5-9ef829edb62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.376311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fcb41-d44d-448a-9cc5-9ef829edb62d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.461974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 792/1569] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:25.462791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf717e7-e5ef-40f8-97ff-f0545eafabd9 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.473210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf717e7-e5ef-40f8-97ff-f0545eafabd9 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.479981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 778/1570] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:25.479981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fcb41-d44d-448a-9cc5-9ef829edb62d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.538025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.538577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.538855 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.539126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.539850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:25.540157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.541790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.542807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fcb41-d44d-448a-9cc5-9ef829edb62d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.548760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31751e86-5fd0-4498-a5c0-56ec564b2c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.549703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31751e86-5fd0-4498-a5c0-56ec564b2c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.549989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31751e86-5fd0-4498-a5c0-56ec564b2c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.550267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31751e86-5fd0-4498-a5c0-56ec564b2c31 admin admin] PATH_INFO: `/v3/projects/373030cbd19f4dcc88d9b494dee196bc/users/ecb6f1bad8054350a7e22120bfb573c6/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.553836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 793/1571] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:25.558394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.565552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31751e86-5fd0-4498-a5c0-56ec564b2c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373030cbd19f4dcc88d9b494dee196bc, user_id=ecb6f1bad8054350a7e22120bfb573c6, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.568258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31751e86-5fd0-4498-a5c0-56ec564b2c31 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.569200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e91a-df43-44c8-b53d-5c4e0243b2be admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.574038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.574730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.575017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.575297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.576027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:25.576417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.578109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.590161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 794/1572] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:25.591653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.601263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808410f7-3ee6-4ca6-8448-3837d7eff0c2 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.605956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715460fa-1226-4710-8e77-337a6f2ded1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.607218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715460fa-1226-4710-8e77-337a6f2ded1a admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.607218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715460fa-1226-4710-8e77-337a6f2ded1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.608794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715460fa-1226-4710-8e77-337a6f2ded1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.608794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715460fa-1226-4710-8e77-337a6f2ded1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.610549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715460fa-1226-4710-8e77-337a6f2ded1a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.632976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 779/1573] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:25 2022] PUT /identity/v3/projects/373030cbd19f4dcc88d9b494dee196bc/users/ecb6f1bad8054350a7e22120bfb573c6/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:25.633817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31751e86-5fd0-4498-a5c0-56ec564b2c31 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.695398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31751e86-5fd0-4498-a5c0-56ec564b2c31 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.701939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ac0e-54f4-486a-9cfc-35091fec2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.701939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ac0e-54f4-486a-9cfc-35091fec2d5b admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.701939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ac0e-54f4-486a-9cfc-35091fec2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.701939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ac0e-54f4-486a-9cfc-35091fec2d5b admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.702661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805ac0e-54f4-486a-9cfc-35091fec2d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.704598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805ac0e-54f4-486a-9cfc-35091fec2d5b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.752802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 795/1574] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:25.752802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715460fa-1226-4710-8e77-337a6f2ded1a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.846073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 780/1575] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:25.847135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ac0e-54f4-486a-9cfc-35091fec2d5b admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.858696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ac0e-54f4-486a-9cfc-35091fec2d5b admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.889995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715460fa-1226-4710-8e77-337a6f2ded1a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.895282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78331947-6da2-4b27-be00-7d43636f2cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.895963 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78331947-6da2-4b27-be00-7d43636f2cad admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.896242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78331947-6da2-4b27-be00-7d43636f2cad admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.896513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78331947-6da2-4b27-be00-7d43636f2cad admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.897200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78331947-6da2-4b27-be00-7d43636f2cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.899314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78331947-6da2-4b27-be00-7d43636f2cad admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.916946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f526-f31d-4c82-8210-9c36c290f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.917757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f526-f31d-4c82-8210-9c36c290f04f admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.918037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f526-f31d-4c82-8210-9c36c290f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.918313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59f526-f31d-4c82-8210-9c36c290f04f admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.919214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59f526-f31d-4c82-8210-9c36c290f04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.921876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59f526-f31d-4c82-8210-9c36c290f04f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.932067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 781/1576] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:25.934570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f526-f31d-4c82-8210-9c36c290f04f admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.942848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59f526-f31d-4c82-8210-9c36c290f04f admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.947740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadae79-5a96-45d3-8765-08aae73ec6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.948378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadae79-5a96-45d3-8765-08aae73ec6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.948657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadae79-5a96-45d3-8765-08aae73ec6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.948972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadae79-5a96-45d3-8765-08aae73ec6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.949675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadae79-5a96-45d3-8765-08aae73ec6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:25.952244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadae79-5a96-45d3-8765-08aae73ec6b6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:25.998035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 796/1577] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:25.999403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78331947-6da2-4b27-be00-7d43636f2cad admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.009040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78331947-6da2-4b27-be00-7d43636f2cad admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.014547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b0bd2-f997-40e6-b5a8-957aa7026c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.015192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0bd2-f997-40e6-b5a8-957aa7026c32 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.015477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0bd2-f997-40e6-b5a8-957aa7026c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.015755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0bd2-f997-40e6-b5a8-957aa7026c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.016437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b0bd2-f997-40e6-b5a8-957aa7026c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.018468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b0bd2-f997-40e6-b5a8-957aa7026c32 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.102117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 782/1578] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:26.107010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadae79-5a96-45d3-8765-08aae73ec6b6 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.113200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadae79-5a96-45d3-8765-08aae73ec6b6 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.118039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61061774-c309-4135-9644-9c2601e74223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.118707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61061774-c309-4135-9644-9c2601e74223 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.118972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61061774-c309-4135-9644-9c2601e74223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.119252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61061774-c309-4135-9644-9c2601e74223 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.119942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61061774-c309-4135-9644-9c2601e74223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.121885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61061774-c309-4135-9644-9c2601e74223 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.143784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 797/1579] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:25 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:26.145144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2eaa-235a-4025-babf-f4548846c27d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.145459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2eaa-235a-4025-babf-f4548846c27d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.145886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a2eaa-235a-4025-babf-f4548846c27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.163407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8a3a2eaa-235a-4025-babf-f4548846c27d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:26.164615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8a3a2eaa-235a-4025-babf-f4548846c27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:26.222678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 798/1580] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:26.223651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a2eaa-235a-4025-babf-f4548846c27d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.234191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a2eaa-235a-4025-babf-f4548846c27d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.238931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba9af-96f5-486f-9464-1ebfa44add7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.239610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba9af-96f5-486f-9464-1ebfa44add7d admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.239911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba9af-96f5-486f-9464-1ebfa44add7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.240169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eba9af-96f5-486f-9464-1ebfa44add7d admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.240870 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eba9af-96f5-486f-9464-1ebfa44add7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.241559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 783/1581] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:26 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:26.243092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eba9af-96f5-486f-9464-1ebfa44add7d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.245291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61061774-c309-4135-9644-9c2601e74223 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.310439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61061774-c309-4135-9644-9c2601e74223 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.315140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f995ff-33d5-4292-a1d5-969a023312e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.315792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f995ff-33d5-4292-a1d5-969a023312e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.316077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f995ff-33d5-4292-a1d5-969a023312e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.316350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f995ff-33d5-4292-a1d5-969a023312e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.317080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f995ff-33d5-4292-a1d5-969a023312e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.318730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f995ff-33d5-4292-a1d5-969a023312e9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.328572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 784/1582] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.329498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f995ff-33d5-4292-a1d5-969a023312e9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.331934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 799/1583] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:26 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:26.331934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba9af-96f5-486f-9464-1ebfa44add7d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.341740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f995ff-33d5-4292-a1d5-969a023312e9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.342736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eba9af-96f5-486f-9464-1ebfa44add7d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.346422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fb82e-3cac-4a64-96e3-7c4ec9467dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.347108 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fb82e-3cac-4a64-96e3-7c4ec9467dff admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.347387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fb82e-3cac-4a64-96e3-7c4ec9467dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.347496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d1417-c69a-439b-9289-72b168d3c4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.347674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fb82e-3cac-4a64-96e3-7c4ec9467dff admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.348224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d1417-c69a-439b-9289-72b168d3c4ab admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.348423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fb82e-3cac-4a64-96e3-7c4ec9467dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.348521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d1417-c69a-439b-9289-72b168d3c4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.348774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d1417-c69a-439b-9289-72b168d3c4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.349558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d1417-c69a-439b-9289-72b168d3c4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.350051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fb82e-3cac-4a64-96e3-7c4ec9467dff admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.351226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d1417-c69a-439b-9289-72b168d3c4ab admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.361525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 785/1584] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.362352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fb82e-3cac-4a64-96e3-7c4ec9467dff admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.365044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 800/1585] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.365944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d1417-c69a-439b-9289-72b168d3c4ab admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.372513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fb82e-3cac-4a64-96e3-7c4ec9467dff admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.375826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d1417-c69a-439b-9289-72b168d3c4ab admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.380376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.380376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.380376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.380376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.380876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.380985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46a2b-f442-481e-ad81-e429a7500530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.381165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46a2b-f442-481e-ad81-e429a7500530 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.381595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46a2b-f442-481e-ad81-e429a7500530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.381722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.381878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46a2b-f442-481e-ad81-e429a7500530 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.382563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc46a2b-f442-481e-ad81-e429a7500530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.384463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc46a2b-f442-481e-ad81-e429a7500530 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.392940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 786/1586] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.393871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.396332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:26.451433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86e263-b9fd-492f-af96-809dda4bea4f admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.454989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a96bc-04f5-449e-877a-2f6b1494b2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.455629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a96bc-04f5-449e-877a-2f6b1494b2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.455908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a96bc-04f5-449e-877a-2f6b1494b2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.456179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a96bc-04f5-449e-877a-2f6b1494b2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.465263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a96bc-04f5-449e-877a-2f6b1494b2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.465878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 801/1587] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:26 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:26.467339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a96bc-04f5-449e-877a-2f6b1494b2f7 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.467800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46a2b-f442-481e-ad81-e429a7500530 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.477490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 787/1588] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:26.477835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46a2b-f442-481e-ad81-e429a7500530 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.478374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a96bc-04f5-449e-877a-2f6b1494b2f7 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.483924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7c4a4-a812-41ce-a6f6-572762ed76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.484486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7c4a4-a812-41ce-a6f6-572762ed76a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.484772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7c4a4-a812-41ce-a6f6-572762ed76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.485043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7c4a4-a812-41ce-a6f6-572762ed76a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.485762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7c4a4-a812-41ce-a6f6-572762ed76a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.487709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7c4a4-a812-41ce-a6f6-572762ed76a1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.489318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a96bc-04f5-449e-877a-2f6b1494b2f7 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.494293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8b734-68f4-44dd-8ee5-f6b244c7c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.495058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b734-68f4-44dd-8ee5-f6b244c7c393 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.495399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b734-68f4-44dd-8ee5-f6b244c7c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.495737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b734-68f4-44dd-8ee5-f6b244c7c393 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.496539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8b734-68f4-44dd-8ee5-f6b244c7c393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.498379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8b734-68f4-44dd-8ee5-f6b244c7c393 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.509319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 788/1589] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.513124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8b734-68f4-44dd-8ee5-f6b244c7c393 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.520302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8b734-68f4-44dd-8ee5-f6b244c7c393 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.524732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f6ecf-e27b-45a3-8f0a-545f88711d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.525397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f6ecf-e27b-45a3-8f0a-545f88711d46 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.525677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f6ecf-e27b-45a3-8f0a-545f88711d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.525950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f6ecf-e27b-45a3-8f0a-545f88711d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.526662 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f6ecf-e27b-45a3-8f0a-545f88711d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.528277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f6ecf-e27b-45a3-8f0a-545f88711d46 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.538997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 789/1590] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.539946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f6ecf-e27b-45a3-8f0a-545f88711d46 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.549687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f6ecf-e27b-45a3-8f0a-545f88711d46 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.554145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc965619-2e4f-44d7-b939-d5098e975eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.555089 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc965619-2e4f-44d7-b939-d5098e975eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.555370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc965619-2e4f-44d7-b939-d5098e975eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.555645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc965619-2e4f-44d7-b939-d5098e975eb6 admin admin] PATH_INFO: `/v3/projects/835191c086b64391b7fb6ad87f7ba200/users/4bd063abaedb47b0ab26d8cb0954ec85/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.569937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc965619-2e4f-44d7-b939-d5098e975eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835191c086b64391b7fb6ad87f7ba200, user_id=4bd063abaedb47b0ab26d8cb0954ec85, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.572567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc965619-2e4f-44d7-b939-d5098e975eb6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.578161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 802/1591] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:26 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:26.578161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7c4a4-a812-41ce-a6f6-572762ed76a1 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.586238 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7c4a4-a812-41ce-a6f6-572762ed76a1 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.591651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bbac-31cc-41e7-b431-87a863b70300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.592550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bbac-31cc-41e7-b431-87a863b70300 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.592836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bbac-31cc-41e7-b431-87a863b70300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.593117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bbac-31cc-41e7-b431-87a863b70300 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.593888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95bbac-31cc-41e7-b431-87a863b70300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.595527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95bbac-31cc-41e7-b431-87a863b70300 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.606319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 803/1592] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.607480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bbac-31cc-41e7-b431-87a863b70300 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.619297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bbac-31cc-41e7-b431-87a863b70300 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.624950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ddc32-83a7-4447-bd4b-4a8fcac05e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.625649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ddc32-83a7-4447-bd4b-4a8fcac05e88 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.625936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ddc32-83a7-4447-bd4b-4a8fcac05e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.626212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ddc32-83a7-4447-bd4b-4a8fcac05e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.626949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ddc32-83a7-4447-bd4b-4a8fcac05e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.628546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ddc32-83a7-4447-bd4b-4a8fcac05e88 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.639710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 804/1593] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.640729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ddc32-83a7-4447-bd4b-4a8fcac05e88 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.651205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ddc32-83a7-4447-bd4b-4a8fcac05e88 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.656776 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbd8e3-c36e-4d3c-b89c-3c78129a1b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.657507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbd8e3-c36e-4d3c-b89c-3c78129a1b7e admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.657786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbd8e3-c36e-4d3c-b89c-3c78129a1b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.658058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbd8e3-c36e-4d3c-b89c-3c78129a1b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.658797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbd8e3-c36e-4d3c-b89c-3c78129a1b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.660392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbd8e3-c36e-4d3c-b89c-3c78129a1b7e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.672930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 805/1594] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.673931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbd8e3-c36e-4d3c-b89c-3c78129a1b7e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.677359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 790/1595] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:26 2022] PUT /identity/v3/projects/835191c086b64391b7fb6ad87f7ba200/users/4bd063abaedb47b0ab26d8cb0954ec85/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:26.681556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc965619-2e4f-44d7-b939-d5098e975eb6 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.684736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbd8e3-c36e-4d3c-b89c-3c78129a1b7e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.750504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.751463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.751754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.752054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] PATH_INFO: `/v3/projects/a3aa6d4e6b6d4b7f99e11f5d6104fb62/users/0ca157aeabbb4f9da8475ca002dd0239/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.753112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc965619-2e4f-44d7-b939-d5098e975eb6 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.757879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253cb44-fdd7-4598-b01e-46fb68384aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.759133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253cb44-fdd7-4598-b01e-46fb68384aff admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.759133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253cb44-fdd7-4598-b01e-46fb68384aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.759324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253cb44-fdd7-4598-b01e-46fb68384aff admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.759917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253cb44-fdd7-4598-b01e-46fb68384aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.761547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253cb44-fdd7-4598-b01e-46fb68384aff admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.770377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3aa6d4e6b6d4b7f99e11f5d6104fb62, user_id=0ca157aeabbb4f9da8475ca002dd0239, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.771465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING py.warnings [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:03:26.771465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: warnings.warn(msg) May 04 14:03:26.771465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: May 04 14:03:26.781669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.781781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 791/1596] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.781781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253cb44-fdd7-4598-b01e-46fb68384aff admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.790019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253cb44-fdd7-4598-b01e-46fb68384aff admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.795608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc227f-41e6-4a04-bd5d-67ae374b1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.796773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc227f-41e6-4a04-bd5d-67ae374b1ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.797413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc227f-41e6-4a04-bd5d-67ae374b1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.797905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc227f-41e6-4a04-bd5d-67ae374b1ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.799324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc227f-41e6-4a04-bd5d-67ae374b1ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.802451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc227f-41e6-4a04-bd5d-67ae374b1ed6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.813629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 792/1597] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:26.814599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc227f-41e6-4a04-bd5d-67ae374b1ed6 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.835658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc227f-41e6-4a04-bd5d-67ae374b1ed6 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.841213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062c9bf-aa1e-4ab8-bdfb-ca34d9f6ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.842318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c9bf-aa1e-4ab8-bdfb-ca34d9f6ce87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.842709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c9bf-aa1e-4ab8-bdfb-ca34d9f6ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.843044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c9bf-aa1e-4ab8-bdfb-ca34d9f6ce87 admin admin] PATH_INFO: `/v3/projects/a0d59f2420324aa2ba49374bc6de7fd1/users/6ad79698989f4d0e8e7c26b72c92cd0e/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.859712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062c9bf-aa1e-4ab8-bdfb-ca34d9f6ce87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d59f2420324aa2ba49374bc6de7fd1, user_id=6ad79698989f4d0e8e7c26b72c92cd0e, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.862561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062c9bf-aa1e-4ab8-bdfb-ca34d9f6ce87 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.875599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 806/1598] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:26 2022] PUT /identity/v3/projects/a3aa6d4e6b6d4b7f99e11f5d6104fb62/users/0ca157aeabbb4f9da8475ca002dd0239/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:26.875599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:26.937032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a3f2-4c67-40a5-a6b5-10c426b2d9a5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:26.941628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4407ee-5f4e-4164-bb02-476a8b65b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:26.942509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4407ee-5f4e-4164-bb02-476a8b65b132 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:26.942786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4407ee-5f4e-4164-bb02-476a8b65b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:26.943057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4407ee-5f4e-4164-bb02-476a8b65b132 admin admin] PATH_INFO: `/v3/projects/ac9f2ac674ab4b5e87bfdd3bafacec37/users/d41ed3ce637d48109c8d149303da2ddd/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:26.957521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4407ee-5f4e-4164-bb02-476a8b65b132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9f2ac674ab4b5e87bfdd3bafacec37, user_id=d41ed3ce637d48109c8d149303da2ddd, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.960370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4407ee-5f4e-4164-bb02-476a8b65b132 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.964667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 793/1599] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:26 2022] PUT /identity/v3/projects/a0d59f2420324aa2ba49374bc6de7fd1/users/6ad79698989f4d0e8e7c26b72c92cd0e/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:26.967035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062c9bf-aa1e-4ab8-bdfb-ca34d9f6ce87 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.030032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062c9bf-aa1e-4ab8-bdfb-ca34d9f6ce87 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.034954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03c5f0-04b9-400f-b541-0281c0949779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.035628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03c5f0-04b9-400f-b541-0281c0949779 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.037122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03c5f0-04b9-400f-b541-0281c0949779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.037122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03c5f0-04b9-400f-b541-0281c0949779 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.037122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03c5f0-04b9-400f-b541-0281c0949779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.038544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03c5f0-04b9-400f-b541-0281c0949779 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.049786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 794/1600] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:27.051086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514809-4ea3-4609-99b7-576384a52d07 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.051390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514809-4ea3-4609-99b7-576384a52d07 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.051651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e514809-4ea3-4609-99b7-576384a52d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.084525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3e514809-4ea3-4609-99b7-576384a52d07 None None] MFA Rules not processed for user `4bd063abaedb47b0ab26d8cb0954ec85`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:27.086592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3e514809-4ea3-4609-99b7-576384a52d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:27.091686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 807/1601] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:26 2022] PUT /identity/v3/projects/ac9f2ac674ab4b5e87bfdd3bafacec37/users/d41ed3ce637d48109c8d149303da2ddd/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:27.092796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4407ee-5f4e-4164-bb02-476a8b65b132 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.164999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4407ee-5f4e-4164-bb02-476a8b65b132 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.169902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 795/1602] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:27.170407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44678e-1cf3-4dcf-a01b-dfb3f9d192c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.170675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514809-4ea3-4609-99b7-576384a52d07 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.171271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44678e-1cf3-4dcf-a01b-dfb3f9d192c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.171562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44678e-1cf3-4dcf-a01b-dfb3f9d192c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.171846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44678e-1cf3-4dcf-a01b-dfb3f9d192c0 admin admin] PATH_INFO: `/v3/projects/9a1aba7a458a47a4890799c2a16f7118/users/8c98eb1f23bc4d6394db8f229e0c3571/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.181471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e514809-4ea3-4609-99b7-576384a52d07 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.186696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a7722-732d-4365-ac43-3b35f539333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.187367 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7722-732d-4365-ac43-3b35f539333d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.187650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7722-732d-4365-ac43-3b35f539333d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.187778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44678e-1cf3-4dcf-a01b-dfb3f9d192c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1aba7a458a47a4890799c2a16f7118, user_id=8c98eb1f23bc4d6394db8f229e0c3571, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.187923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7722-732d-4365-ac43-3b35f539333d admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.188649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a7722-732d-4365-ac43-3b35f539333d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.190278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a7722-732d-4365-ac43-3b35f539333d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.190468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44678e-1cf3-4dcf-a01b-dfb3f9d192c0 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.201979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 796/1603] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:27.209648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ed41-96e7-4ef7-8a92-79f7b4311485 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.209648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ed41-96e7-4ef7-8a92-79f7b4311485 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.209648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ed41-96e7-4ef7-8a92-79f7b4311485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.222157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-67c7ed41-96e7-4ef7-8a92-79f7b4311485 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:27.223355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-67c7ed41-96e7-4ef7-8a92-79f7b4311485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:27.230904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 797/1604] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:27.232941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e1654-ecba-463b-99ed-48cdfb48a4bc None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.233358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e1654-ecba-463b-99ed-48cdfb48a4bc None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.233737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e1654-ecba-463b-99ed-48cdfb48a4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.261827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-9a9e1654-ecba-463b-99ed-48cdfb48a4bc None None] MFA Rules not processed for user `6ad79698989f4d0e8e7c26b72c92cd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:27.263613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9a9e1654-ecba-463b-99ed-48cdfb48a4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:27.279670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 808/1605] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:27 2022] PUT /identity/v3/projects/9a1aba7a458a47a4890799c2a16f7118/users/8c98eb1f23bc4d6394db8f229e0c3571/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:27.286166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44678e-1cf3-4dcf-a01b-dfb3f9d192c0 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.333105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 798/1606] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:27.334525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9893cc-2eec-4bc9-a609-1228372d72b9 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.334817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9893cc-2eec-4bc9-a609-1228372d72b9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.337166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9893cc-2eec-4bc9-a609-1228372d72b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.359309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0c9893cc-2eec-4bc9-a609-1228372d72b9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:27.360521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0c9893cc-2eec-4bc9-a609-1228372d72b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:27.361627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44678e-1cf3-4dcf-a01b-dfb3f9d192c0 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.367552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccea28b-423d-403d-a833-098ce6b6adad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.368645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea28b-423d-403d-a833-098ce6b6adad admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.369084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea28b-423d-403d-a833-098ce6b6adad admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.369462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea28b-423d-403d-a833-098ce6b6adad admin admin] PATH_INFO: `/v3/projects/8519562477d14e15ac77e0647ec78c88/users/b32e32eb1444401b9b7d8ab3228bdfd0/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.370526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 799/1607] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:27.371809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9893cc-2eec-4bc9-a609-1228372d72b9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.382762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9893cc-2eec-4bc9-a609-1228372d72b9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.388513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccea28b-423d-403d-a833-098ce6b6adad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8519562477d14e15ac77e0647ec78c88, user_id=b32e32eb1444401b9b7d8ab3228bdfd0, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.388668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af302db-35de-4d37-841e-6a295486afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.389656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af302db-35de-4d37-841e-6a295486afb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.390011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccea28b-423d-403d-a833-098ce6b6adad admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.390134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af302db-35de-4d37-841e-6a295486afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.390418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af302db-35de-4d37-841e-6a295486afb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.391187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af302db-35de-4d37-841e-6a295486afb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.393167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af302db-35de-4d37-841e-6a295486afb1 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.473573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 809/1608] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:27 2022] PUT /identity/v3/projects/8519562477d14e15ac77e0647ec78c88/users/b32e32eb1444401b9b7d8ab3228bdfd0/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:27.474547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccea28b-423d-403d-a833-098ce6b6adad admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.505503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 800/1609] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:27.506425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af302db-35de-4d37-841e-6a295486afb1 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.544922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccea28b-423d-403d-a833-098ce6b6adad admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.566554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af302db-35de-4d37-841e-6a295486afb1 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.570821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b96cb-cace-441a-b36d-d73965f1918a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.571049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b96cb-cace-441a-b36d-d73965f1918a service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.571359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b96cb-cace-441a-b36d-d73965f1918a service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.571597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b96cb-cace-441a-b36d-d73965f1918a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.615606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d689f9-8d87-442c-9dac-3e93268a40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.616558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d689f9-8d87-442c-9dac-3e93268a40c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.616847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d689f9-8d87-442c-9dac-3e93268a40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.617118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d689f9-8d87-442c-9dac-3e93268a40c6 admin admin] PATH_INFO: `/v3/projects/8f2eb3020e3141a1a7489ad69f109e83/users/0941f73a00234e489a34aa58e813cf35/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.632705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d689f9-8d87-442c-9dac-3e93268a40c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2eb3020e3141a1a7489ad69f109e83, user_id=0941f73a00234e489a34aa58e813cf35, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.635510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d689f9-8d87-442c-9dac-3e93268a40c6 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.638338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b96cb-cace-441a-b36d-d73965f1918a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.640323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b96cb-cace-441a-b36d-d73965f1918a service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.650403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 801/1610] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:27.652644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726121-e50a-4106-8be6-db3423c0790c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.652939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726121-e50a-4106-8be6-db3423c0790c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.653278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726121-e50a-4106-8be6-db3423c0790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.672096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-53726121-e50a-4106-8be6-db3423c0790c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:27.673346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-53726121-e50a-4106-8be6-db3423c0790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:27.681548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 802/1611] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:27.683133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67167fb-b56c-4428-b17e-c73de69736fe None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.683427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67167fb-b56c-4428-b17e-c73de69736fe None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.683710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67167fb-b56c-4428-b17e-c73de69736fe None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.685940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 803/1612] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 14:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:03:27.686472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67167fb-b56c-4428-b17e-c73de69736fe None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.697182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67167fb-b56c-4428-b17e-c73de69736fe None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.701629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf061b0-4421-4f8c-8dc7-a2a78373c972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.702263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf061b0-4421-4f8c-8dc7-a2a78373c972 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.702551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf061b0-4421-4f8c-8dc7-a2a78373c972 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.702827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf061b0-4421-4f8c-8dc7-a2a78373c972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.712453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf061b0-4421-4f8c-8dc7-a2a78373c972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.713935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf061b0-4421-4f8c-8dc7-a2a78373c972 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.723394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 804/1613] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:27.724610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49674e-6c0c-4b25-bbad-978de492f53f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.724892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49674e-6c0c-4b25-bbad-978de492f53f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.725163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49674e-6c0c-4b25-bbad-978de492f53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.736886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 810/1614] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:27 2022] PUT /identity/v3/projects/8f2eb3020e3141a1a7489ad69f109e83/users/0941f73a00234e489a34aa58e813cf35/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:27.737903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d689f9-8d87-442c-9dac-3e93268a40c6 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.747667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-8d49674e-6c0c-4b25-bbad-978de492f53f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:27.749937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-8d49674e-6c0c-4b25-bbad-978de492f53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:27.833144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d689f9-8d87-442c-9dac-3e93268a40c6 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.839388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 805/1615] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:27.839388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a2645-3fff-4968-8721-a16ecbb2f86b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.839388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a2645-3fff-4968-8721-a16ecbb2f86b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.839388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a2645-3fff-4968-8721-a16ecbb2f86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.839783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27ab9d-32f4-48e0-98de-ceb42881f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.840417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27ab9d-32f4-48e0-98de-ceb42881f316 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.840724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27ab9d-32f4-48e0-98de-ceb42881f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.841398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27ab9d-32f4-48e0-98de-ceb42881f316 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.842236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27ab9d-32f4-48e0-98de-ceb42881f316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.844609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27ab9d-32f4-48e0-98de-ceb42881f316 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.862778 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-807a2645-3fff-4968-8721-a16ecbb2f86b None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:27.864661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-807a2645-3fff-4968-8721-a16ecbb2f86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:27.952044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 806/1616] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:27.956166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a2645-3fff-4968-8721-a16ecbb2f86b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.985865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 811/1617] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:27.988532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d47f1-f834-4e4a-a787-6269b59ac490 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.989367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d47f1-f834-4e4a-a787-6269b59ac490 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.989924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d47f1-f834-4e4a-a787-6269b59ac490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.017497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a2645-3fff-4968-8721-a16ecbb2f86b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.021756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d482ff-f8ce-4993-909a-847491c3157a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.022468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d482ff-f8ce-4993-909a-847491c3157a service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.022756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d482ff-f8ce-4993-909a-847491c3157a service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.023031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d482ff-f8ce-4993-909a-847491c3157a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.023825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4a9d47f1-f834-4e4a-a787-6269b59ac490 None None] MFA Rules not processed for user `0941f73a00234e489a34aa58e813cf35`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:28.025145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4a9d47f1-f834-4e4a-a787-6269b59ac490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:28.034834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d482ff-f8ce-4993-909a-847491c3157a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.036003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d482ff-f8ce-4993-909a-847491c3157a service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.047020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 807/1618] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:28.047972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d482ff-f8ce-4993-909a-847491c3157a service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.057222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d482ff-f8ce-4993-909a-847491c3157a service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.062343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7237bb1-931d-4058-a022-2efdc6a7d786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.062921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7237bb1-931d-4058-a022-2efdc6a7d786 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.065306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7237bb1-931d-4058-a022-2efdc6a7d786 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.065306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7237bb1-931d-4058-a022-2efdc6a7d786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.078069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7237bb1-931d-4058-a022-2efdc6a7d786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.079652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7237bb1-931d-4058-a022-2efdc6a7d786 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.096505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 808/1619] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:28.097488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7237bb1-931d-4058-a022-2efdc6a7d786 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.117043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7237bb1-931d-4058-a022-2efdc6a7d786 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.122834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 812/1620] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:28.122834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d47f1-f834-4e4a-a787-6269b59ac490 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.123086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14b2f-d91c-4083-aab6-b33a1ce457f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.123086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14b2f-d91c-4083-aab6-b33a1ce457f3 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.123398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14b2f-d91c-4083-aab6-b33a1ce457f3 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.123829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14b2f-d91c-4083-aab6-b33a1ce457f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.131484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d47f1-f834-4e4a-a787-6269b59ac490 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.137167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef078c-169e-421a-9256-71cd4fcdd65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.138754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef078c-169e-421a-9256-71cd4fcdd65f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.139261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef078c-169e-421a-9256-71cd4fcdd65f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.139718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef078c-169e-421a-9256-71cd4fcdd65f admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.140655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef078c-169e-421a-9256-71cd4fcdd65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.142697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef078c-169e-421a-9256-71cd4fcdd65f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.156952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 813/1621] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:28.158751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce501d-52fb-4c4e-90c8-6ab8dfcf90af None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.159179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce501d-52fb-4c4e-90c8-6ab8dfcf90af None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.159741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce501d-52fb-4c4e-90c8-6ab8dfcf90af None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.161451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 814/1622] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 14:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:03:28.162387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce501d-52fb-4c4e-90c8-6ab8dfcf90af None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.177930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce501d-52fb-4c4e-90c8-6ab8dfcf90af None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.184581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f497a1-255f-47fa-ac64-b98417614093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.185797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f497a1-255f-47fa-ac64-b98417614093 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.186231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f497a1-255f-47fa-ac64-b98417614093 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.186662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f497a1-255f-47fa-ac64-b98417614093 admin admin] PATH_INFO: `/v3/projects/e2a8ef7c573d4f9b9879ee9ae8cc90af/users/352a574782ce4da69f9f76dd61d8ad8f/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.208567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f497a1-255f-47fa-ac64-b98417614093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a8ef7c573d4f9b9879ee9ae8cc90af, user_id=352a574782ce4da69f9f76dd61d8ad8f, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.212812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f497a1-255f-47fa-ac64-b98417614093 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.276243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14b2f-d91c-4083-aab6-b33a1ce457f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.276243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14b2f-d91c-4083-aab6-b33a1ce457f3 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.296520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 809/1623] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:28.298006 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9398ad-6aa5-4aee-aa5f-588d7c9350d2 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.298602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9398ad-6aa5-4aee-aa5f-588d7c9350d2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.298713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9398ad-6aa5-4aee-aa5f-588d7c9350d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.315012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 815/1624] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:28 2022] PUT /identity/v3/projects/e2a8ef7c573d4f9b9879ee9ae8cc90af/users/352a574782ce4da69f9f76dd61d8ad8f/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:28.319619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f497a1-255f-47fa-ac64-b98417614093 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.337449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-9d9398ad-6aa5-4aee-aa5f-588d7c9350d2 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:28.339047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9d9398ad-6aa5-4aee-aa5f-588d7c9350d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:28.394938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f497a1-255f-47fa-ac64-b98417614093 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.400410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7965d-87d3-4984-8f2d-01ed3c7bc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.401093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7965d-87d3-4984-8f2d-01ed3c7bc501 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.401411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7965d-87d3-4984-8f2d-01ed3c7bc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.401706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7965d-87d3-4984-8f2d-01ed3c7bc501 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.402492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7965d-87d3-4984-8f2d-01ed3c7bc501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.405273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7965d-87d3-4984-8f2d-01ed3c7bc501 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.417471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 816/1625] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:03:28.443710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7965d-87d3-4984-8f2d-01ed3c7bc501 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.466959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7965d-87d3-4984-8f2d-01ed3c7bc501 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.473104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00244ee0-9939-4e01-80f7-62311f56d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.474365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00244ee0-9939-4e01-80f7-62311f56d1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.474746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00244ee0-9939-4e01-80f7-62311f56d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.475122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00244ee0-9939-4e01-80f7-62311f56d1d5 admin admin] PATH_INFO: `/v3/projects/e2a8ef7c573d4f9b9879ee9ae8cc90af/users/352a574782ce4da69f9f76dd61d8ad8f/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.478079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00244ee0-9939-4e01-80f7-62311f56d1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a8ef7c573d4f9b9879ee9ae8cc90af, user_id=352a574782ce4da69f9f76dd61d8ad8f, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.481047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00244ee0-9939-4e01-80f7-62311f56d1d5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.505330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 817/1626] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:28 2022] PUT /identity/v3/projects/e2a8ef7c573d4f9b9879ee9ae8cc90af/users/352a574782ce4da69f9f76dd61d8ad8f/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:28.507477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f754fa9-9b61-48cb-b573-c45b3cbd6235 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.507864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f754fa9-9b61-48cb-b573-c45b3cbd6235 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.508296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f754fa9-9b61-48cb-b573-c45b3cbd6235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.511574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 810/1627] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 14:03:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:28.519645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9398ad-6aa5-4aee-aa5f-588d7c9350d2 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.539676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9398ad-6aa5-4aee-aa5f-588d7c9350d2 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.543839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4f754fa9-9b61-48cb-b573-c45b3cbd6235 None None] MFA Rules not processed for user `352a574782ce4da69f9f76dd61d8ad8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:28.546137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4f754fa9-9b61-48cb-b573-c45b3cbd6235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:28.652477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 818/1628] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:03:28.666881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f754fa9-9b61-48cb-b573-c45b3cbd6235 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.669940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1c35-053e-49fb-bf67-24c81fe077b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.672757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1c35-053e-49fb-bf67-24c81fe077b2 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.673054 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1c35-053e-49fb-bf67-24c81fe077b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.673352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1c35-053e-49fb-bf67-24c81fe077b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.772964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f754fa9-9b61-48cb-b573-c45b3cbd6235 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.789683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401aeeaf-e4d5-4d64-8f83-9c87ca7ad860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.790352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aeeaf-e4d5-4d64-8f83-9c87ca7ad860 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.791299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aeeaf-e4d5-4d64-8f83-9c87ca7ad860 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.791299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aeeaf-e4d5-4d64-8f83-9c87ca7ad860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.792776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1c35-053e-49fb-bf67-24c81fe077b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.796121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1c35-053e-49fb-bf67-24c81fe077b2 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.817147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aeeaf-e4d5-4d64-8f83-9c87ca7ad860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.818408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401aeeaf-e4d5-4d64-8f83-9c87ca7ad860 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:28.826995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 811/1629] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:28.848247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 819/1630] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:28.876932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3bfd5-c0f1-48ad-b481-3b82ceb087f5 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.877228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3bfd5-c0f1-48ad-b481-3b82ceb087f5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.877552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3bfd5-c0f1-48ad-b481-3b82ceb087f5 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.878987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 812/1631] 10.222.0.69 () {54 vars in 912 bytes} [Wed May 4 14:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:03:28.885219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b51e-34a2-4353-85a6-141f482399c0 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.885533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b51e-34a2-4353-85a6-141f482399c0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.885812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b51e-34a2-4353-85a6-141f482399c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.911917 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7ac6b51e-34a2-4353-85a6-141f482399c0 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:28.911917 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7ac6b51e-34a2-4353-85a6-141f482399c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:28.928967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 820/1632] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:03:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:28.937653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3bfd5-c0f1-48ad-b481-3b82ceb087f5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:28.956938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3bfd5-c0f1-48ad-b481-3b82ceb087f5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:28.961178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbbac5-e27a-4c6b-89db-ffd6d2e4c9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:28.961796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbbac5-e27a-4c6b-89db-ffd6d2e4c9ba service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:28.962609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbbac5-e27a-4c6b-89db-ffd6d2e4c9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:28.962609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbbac5-e27a-4c6b-89db-ffd6d2e4c9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:28.975287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbbac5-e27a-4c6b-89db-ffd6d2e4c9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:28.976783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbbac5-e27a-4c6b-89db-ffd6d2e4c9ba service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:29.005379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 813/1633] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:29.163088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6b51e-34a2-4353-85a6-141f482399c0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:29.176098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6b51e-34a2-4353-85a6-141f482399c0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:29.187841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef346-deb9-438a-8a15-21e94633af31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:29.188777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef346-deb9-438a-8a15-21e94633af31 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:29.189058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef346-deb9-438a-8a15-21e94633af31 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:29.189353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef346-deb9-438a-8a15-21e94633af31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:29.323362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bda3c1-af16-4b1b-9618-dbeb6c37d2b8 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:29.323913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bda3c1-af16-4b1b-9618-dbeb6c37d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:29.324879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef346-deb9-438a-8a15-21e94633af31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:29.324998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bda3c1-af16-4b1b-9618-dbeb6c37d2b8 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:29.326016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 814/1634] 10.222.0.69 () {54 vars in 912 bytes} [Wed May 4 14:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:03:29.326144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef346-deb9-438a-8a15-21e94633af31 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:29.337566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba7b2c-ce70-4036-9d6f-13b0fca76436 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:29.337838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba7b2c-ce70-4036-9d6f-13b0fca76436 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:29.338125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba7b2c-ce70-4036-9d6f-13b0fca76436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:29.354160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 821/1635] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:03:29.373841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d5ba7b2c-ce70-4036-9d6f-13b0fca76436 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:29.375313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d5ba7b2c-ce70-4036-9d6f-13b0fca76436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:29.417071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 815/1636] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:03:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:03:29.443393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef346-deb9-438a-8a15-21e94633af31 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:29.445486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba7b2c-ce70-4036-9d6f-13b0fca76436 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:29.455975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba7b2c-ce70-4036-9d6f-13b0fca76436 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:29.461618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a624190-20d4-495e-aa3a-85b582c4ddec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:29.462532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624190-20d4-495e-aa3a-85b582c4ddec service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:29.463140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624190-20d4-495e-aa3a-85b582c4ddec service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:29.463707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a624190-20d4-495e-aa3a-85b582c4ddec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:29.480543 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a624190-20d4-495e-aa3a-85b582c4ddec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:29.483309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a624190-20d4-495e-aa3a-85b582c4ddec service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:29.512452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 816/1637] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:03:29.611252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef346-deb9-438a-8a15-21e94633af31 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:29.618272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:29.619573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:29.624646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:29.625312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] PATH_INFO: `/v3/users/6ad79698989f4d0e8e7c26b72c92cd0e` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:29.626975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad79698989f4d0e8e7c26b72c92cd0e)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:29.628780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: WARNING py.warnings [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:03:29.628780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: warnings.warn(msg) May 04 14:03:29.628780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: May 04 14:03:29.630666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:29.902780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad79698989f4d0e8e7c26b72c92cd0e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:29.932962 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad79698989f4d0e8e7c26b72c92cd0e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:29.933885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad79698989f4d0e8e7c26b72c92cd0e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:29.934579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad79698989f4d0e8e7c26b72c92cd0e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:30.033010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad79698989f4d0e8e7c26b72c92cd0e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:30.086598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 822/1638] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:03:29 2022] DELETE /identity/v3/users/6ad79698989f4d0e8e7c26b72c92cd0e => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:30.090228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7adf07-f484-43e4-8769-ba66c79c7b71 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:30.097913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7adf07-f484-43e4-8769-ba66c79c7b71 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:30.097913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7adf07-f484-43e4-8769-ba66c79c7b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:30.131868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1a7adf07-f484-43e4-8769-ba66c79c7b71 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:30.142818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1a7adf07-f484-43e4-8769-ba66c79c7b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:30.273989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 817/1639] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:30.306194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:30.307772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:30.414037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dab77e-240c-4939-92c2-db40182d5bae admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:30.424292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8239d13-09a8-4851-b3f7-e7064e44274f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:30.425509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8239d13-09a8-4851-b3f7-e7064e44274f service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:30.425830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8239d13-09a8-4851-b3f7-e7064e44274f service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:30.426566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8239d13-09a8-4851-b3f7-e7064e44274f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:30.438339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8239d13-09a8-4851-b3f7-e7064e44274f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:30.439899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8239d13-09a8-4851-b3f7-e7064e44274f service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:30.452854 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 823/1640] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:30.882173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2e57-ddfa-4401-8bbb-f18b317efca8 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:30.883049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2e57-ddfa-4401-8bbb-f18b317efca8 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:30.883510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2e57-ddfa-4401-8bbb-f18b317efca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:30.938980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-21cf2e57-ddfa-4401-8bbb-f18b317efca8 None None] MFA Rules not processed for user `d41ed3ce637d48109c8d149303da2ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:30.940496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-21cf2e57-ddfa-4401-8bbb-f18b317efca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:31.007818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8fab-fc74-45e1-88a6-f7aeba246a43 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:31.008488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8fab-fc74-45e1-88a6-f7aeba246a43 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:31.008957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8fab-fc74-45e1-88a6-f7aeba246a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:31.076156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-42dd8fab-fc74-45e1-88a6-f7aeba246a43 None None] MFA Rules not processed for user `8c98eb1f23bc4d6394db8f229e0c3571`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:31.079596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 818/1641] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:31.080398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-42dd8fab-fc74-45e1-88a6-f7aeba246a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:31.094188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6257-91fa-4208-a55a-e6ae88a2e1bd None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:31.094582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6257-91fa-4208-a55a-e6ae88a2e1bd None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:31.095025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb6257-91fa-4208-a55a-e6ae88a2e1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:31.134377 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-5ffb6257-91fa-4208-a55a-e6ae88a2e1bd None None] MFA Rules not processed for user `d41ed3ce637d48109c8d149303da2ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:31.138749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5ffb6257-91fa-4208-a55a-e6ae88a2e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:31.159694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 819/1642] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:31.173572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb6257-91fa-4208-a55a-e6ae88a2e1bd None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:31.179888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5ffb6257-91fa-4208-a55a-e6ae88a2e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:31.233704 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 824/1643] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:03:31.238921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8fab-fc74-45e1-88a6-f7aeba246a43 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:31.245348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-42dd8fab-fc74-45e1-88a6-f7aeba246a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:31.275377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8fab-fc74-45e1-88a6-f7aeba246a43 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:31.287692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d930267-4798-49ad-9dd4-4c0c55dbb064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:31.288608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d930267-4798-49ad-9dd4-4c0c55dbb064 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:31.288761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d930267-4798-49ad-9dd4-4c0c55dbb064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:31.289117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d930267-4798-49ad-9dd4-4c0c55dbb064 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:31.289885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d930267-4798-49ad-9dd4-4c0c55dbb064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:31.297428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d930267-4798-49ad-9dd4-4c0c55dbb064 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:31.312004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb6257-91fa-4208-a55a-e6ae88a2e1bd None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:31.323819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9769e6d-41c1-4c6d-9479-91fbba6a7d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:31.325153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769e6d-41c1-4c6d-9479-91fbba6a7d7f service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:31.331793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769e6d-41c1-4c6d-9479-91fbba6a7d7f service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:31.331793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769e6d-41c1-4c6d-9479-91fbba6a7d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:31.360204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9769e6d-41c1-4c6d-9479-91fbba6a7d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:31.360204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9769e6d-41c1-4c6d-9479-91fbba6a7d7f service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:31.375531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 820/1644] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:03:31.433867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 825/1645] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:31 2022] POST /identity/v3/projects => generated 405 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:31.438420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9769e6d-41c1-4c6d-9479-91fbba6a7d7f service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:31.460712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9769e6d-41c1-4c6d-9479-91fbba6a7d7f service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:31.622079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00abfa-91e9-499b-8e89-a52377a90e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:31.992941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00abfa-91e9-499b-8e89-a52377a90e3a admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:31.992941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00abfa-91e9-499b-8e89-a52377a90e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:31.992941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00abfa-91e9-499b-8e89-a52377a90e3a admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:31.992941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00abfa-91e9-499b-8e89-a52377a90e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:31.992941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00abfa-91e9-499b-8e89-a52377a90e3a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:31.992941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 821/1646] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:31 2022] POST /identity/v3/users => generated 309 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:31.994541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d930267-4798-49ad-9dd4-4c0c55dbb064 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:31.994541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d930267-4798-49ad-9dd4-4c0c55dbb064 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:31.994541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:31.994541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:31.995586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:31.995586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:31.995586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:31.995586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:31.995586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 826/1647] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:31.996182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00abfa-91e9-499b-8e89-a52377a90e3a admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:31.996182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00abfa-91e9-499b-8e89-a52377a90e3a admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:31.996182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628013-1ed2-4ac5-9876-c7584c982d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:31.996182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628013-1ed2-4ac5-9876-c7584c982d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:31.996514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628013-1ed2-4ac5-9876-c7584c982d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:31.996514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628013-1ed2-4ac5-9876-c7584c982d58 admin admin] PATH_INFO: `/v3/projects/5ccc6410376f4e18a855f227ca4be07d/users/c673e88f380147eaa1718d6a7a80744b/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:31.996514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd628013-1ed2-4ac5-9876-c7584c982d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccc6410376f4e18a855f227ca4be07d, user_id=c673e88f380147eaa1718d6a7a80744b, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:31.996514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd628013-1ed2-4ac5-9876-c7584c982d58 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:31.997096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:31.997096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:31.997096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeadba5-cd20-4be1-82e6-985b9b3d5983 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:32.002570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:32.002570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.002570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.002570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] PATH_INFO: `/v3/projects/a0d59f2420324aa2ba49374bc6de7fd1` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.003021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d59f2420324aa2ba49374bc6de7fd1)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:32.024482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:32.140475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 822/1648] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:31 2022] PUT /identity/v3/projects/5ccc6410376f4e18a855f227ca4be07d/users/c673e88f380147eaa1718d6a7a80744b/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:03:32.144403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628013-1ed2-4ac5-9876-c7584c982d58 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:32.287549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628013-1ed2-4ac5-9876-c7584c982d58 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:32.320446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d59f2420324aa2ba49374bc6de7fd1', 'request_id': 'req-3ef61510-ca91-4125-95f7-9cb81e005943'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:32.407820 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0cfe2-6e91-476f-b546-2957f99a3450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:32.409295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0cfe2-6e91-476f-b546-2957f99a3450 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.409684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0cfe2-6e91-476f-b546-2957f99a3450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.410719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0cfe2-6e91-476f-b546-2957f99a3450 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.411687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0cfe2-6e91-476f-b546-2957f99a3450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:32.418270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0cfe2-6e91-476f-b546-2957f99a3450 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:32.440491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 823/1649] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:03:32.442161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca1d3a-7689-468d-a21d-e05dd3d8b140 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.442567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca1d3a-7689-468d-a21d-e05dd3d8b140 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.443329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca1d3a-7689-468d-a21d-e05dd3d8b140 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.444698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 824/1650] 10.222.0.69 () {54 vars in 912 bytes} [Wed May 4 14:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:03:32.445501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca1d3a-7689-468d-a21d-e05dd3d8b140 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:32.457813 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d59f2420324aa2ba49374bc6de7fd1', 'request_id': 'req-3ef61510-ca91-4125-95f7-9cb81e005943'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:32.470521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d59f2420324aa2ba49374bc6de7fd1', 'request_id': 'req-3ef61510-ca91-4125-95f7-9cb81e005943'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:32.472242 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca1d3a-7689-468d-a21d-e05dd3d8b140 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:32.484897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] The token cache is being invalidate because project a0d59f2420324aa2ba49374bc6de7fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:32.485345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:32.487971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e45aa2-a066-499c-9459-ebe756345285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:32.488094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3ef61510-ca91-4125-95f7-9cb81e005943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:32.488175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45aa2-a066-499c-9459-ebe756345285 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.488750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45aa2-a066-499c-9459-ebe756345285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.488912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 827/1651] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:03:31 2022] DELETE /identity/v3/projects/a0d59f2420324aa2ba49374bc6de7fd1 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:03:32.489071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45aa2-a066-499c-9459-ebe756345285 admin admin] PATH_INFO: `/v3/projects/5ccc6410376f4e18a855f227ca4be07d/users/c673e88f380147eaa1718d6a7a80744b/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.490304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59487a5-38cf-4514-aed6-55e92fea2b03 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.490587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59487a5-38cf-4514-aed6-55e92fea2b03 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.490870 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59487a5-38cf-4514-aed6-55e92fea2b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.497656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e45aa2-a066-499c-9459-ebe756345285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccc6410376f4e18a855f227ca4be07d, user_id=c673e88f380147eaa1718d6a7a80744b, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:32.501090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e45aa2-a066-499c-9459-ebe756345285 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:32.521173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 825/1652] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:32 2022] PUT /identity/v3/projects/5ccc6410376f4e18a855f227ca4be07d/users/c673e88f380147eaa1718d6a7a80744b/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:32.527240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b52e8-f8f3-4878-b9fd-5d24c129f912 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.530106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b52e8-f8f3-4878-b9fd-5d24c129f912 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.530443 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b52e8-f8f3-4878-b9fd-5d24c129f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.559932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-e59487a5-38cf-4514-aed6-55e92fea2b03 None None] MFA Rules not processed for user `378bf86fc54142ee85dc16cce3664978`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:32.563557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-014b52e8-f8f3-4878-b9fd-5d24c129f912 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:32.564701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e59487a5-38cf-4514-aed6-55e92fea2b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:32.565173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-014b52e8-f8f3-4878-b9fd-5d24c129f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:32.679684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 828/1653] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:32.682827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 826/1654] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:32.691041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d910438-0ecd-4c29-8340-b138ee260e69 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.691399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d910438-0ecd-4c29-8340-b138ee260e69 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.691831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d910438-0ecd-4c29-8340-b138ee260e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.693639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b52e8-f8f3-4878-b9fd-5d24c129f912 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:32.695510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-014b52e8-f8f3-4878-b9fd-5d24c129f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:32.712207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b52e8-f8f3-4878-b9fd-5d24c129f912 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:32.717899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99839cb-f0ec-444d-8479-fb414b032980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:32.722093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99839cb-f0ec-444d-8479-fb414b032980 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.722093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99839cb-f0ec-444d-8479-fb414b032980 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.722093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99839cb-f0ec-444d-8479-fb414b032980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.728493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99839cb-f0ec-444d-8479-fb414b032980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:32.730173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99839cb-f0ec-444d-8479-fb414b032980 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:32.735733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0d910438-0ecd-4c29-8340-b138ee260e69 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:32.739730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0d910438-0ecd-4c29-8340-b138ee260e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:32.754957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 827/1655] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:32.780730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 829/1656] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:32.782240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99839cb-f0ec-444d-8479-fb414b032980 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:32.800188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99839cb-f0ec-444d-8479-fb414b032980 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:32.807497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:32.808265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.808715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.809001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.810700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:32.811020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:32.814243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:32.844735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 828/1657] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:32.851746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d910438-0ecd-4c29-8340-b138ee260e69 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:32.861902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d910438-0ecd-4c29-8340-b138ee260e69 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:32.876755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a74f-902e-498e-a4b4-93c37f5717c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:32.877547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a74f-902e-498e-a4b4-93c37f5717c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:32.877908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a74f-902e-498e-a4b4-93c37f5717c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:32.878239 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a74f-902e-498e-a4b4-93c37f5717c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:32.879006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87a74f-902e-498e-a4b4-93c37f5717c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:32.880997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87a74f-902e-498e-a4b4-93c37f5717c2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:33.023849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 830/1658] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:32 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:33.027482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:33.042063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502014c3-4a0a-427b-bc77-8c752aaec441 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:33.159024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1cf4b-e26b-4381-ba40-c995e99534fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:33.159817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1cf4b-e26b-4381-ba40-c995e99534fa admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:33.160102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1cf4b-e26b-4381-ba40-c995e99534fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:33.161693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1cf4b-e26b-4381-ba40-c995e99534fa admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:33.161693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1cf4b-e26b-4381-ba40-c995e99534fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:33.164005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1cf4b-e26b-4381-ba40-c995e99534fa admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:33.268624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 829/1659] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:33 2022] POST /identity/v3/users => generated 282 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:33.275590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a74f-902e-498e-a4b4-93c37f5717c2 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:33.296627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87a74f-902e-498e-a4b4-93c37f5717c2 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:33.314035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78699f-76dd-4ed0-8dc7-701da7d244f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:33.316911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78699f-76dd-4ed0-8dc7-701da7d244f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:33.317344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78699f-76dd-4ed0-8dc7-701da7d244f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:33.317725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78699f-76dd-4ed0-8dc7-701da7d244f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:33.318581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78699f-76dd-4ed0-8dc7-701da7d244f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:33.322300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78699f-76dd-4ed0-8dc7-701da7d244f4 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:33.351896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 831/1660] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:33.355706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1cf4b-e26b-4381-ba40-c995e99534fa admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:33.369173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1cf4b-e26b-4381-ba40-c995e99534fa admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:33.383104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7278b-1175-4f82-bf1e-cd1cd7386f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:33.383943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7278b-1175-4f82-bf1e-cd1cd7386f15 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:33.384236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7278b-1175-4f82-bf1e-cd1cd7386f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:33.384515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7278b-1175-4f82-bf1e-cd1cd7386f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:33.389102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7278b-1175-4f82-bf1e-cd1cd7386f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:33.391155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7278b-1175-4f82-bf1e-cd1cd7386f15 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:33.413928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 830/1661] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:33.415735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78699f-76dd-4ed0-8dc7-701da7d244f4 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:33.429614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78699f-76dd-4ed0-8dc7-701da7d244f4 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:33.447298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faf860-f089-46f5-88dd-85898466c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:33.448393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf860-f089-46f5-88dd-85898466c0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:33.448779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf860-f089-46f5-88dd-85898466c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:33.449154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf860-f089-46f5-88dd-85898466c0d1 admin admin] PATH_INFO: `/v3/projects/294559712ad14745a10c85f672d8d380/users/8294fe40bbf9486bbbd3b23561621469/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:33.476708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faf860-f089-46f5-88dd-85898466c0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294559712ad14745a10c85f672d8d380, user_id=8294fe40bbf9486bbbd3b23561621469, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:33.479640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faf860-f089-46f5-88dd-85898466c0d1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:33.683995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 832/1662] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:33 2022] PUT /identity/v3/projects/294559712ad14745a10c85f672d8d380/users/8294fe40bbf9486bbbd3b23561621469/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:33.687985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b9f9-25e8-4304-b9a4-caedb8c3633d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:33.688293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b9f9-25e8-4304-b9a4-caedb8c3633d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:33.688386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0b9f9-25e8-4304-b9a4-caedb8c3633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:33.783649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-73a0b9f9-25e8-4304-b9a4-caedb8c3633d None None] MFA Rules not processed for user `8294fe40bbf9486bbbd3b23561621469`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:33.785300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-73a0b9f9-25e8-4304-b9a4-caedb8c3633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:33.957656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac509f-6aff-42cc-b7e2-8c601dcc096d None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:33.957656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac509f-6aff-42cc-b7e2-8c601dcc096d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:33.957656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac509f-6aff-42cc-b7e2-8c601dcc096d None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:33.957656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 833/1663] 10.222.0.69 () {54 vars in 960 bytes} [Wed May 4 14:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:03:33.965549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacdd7-9dd5-442b-b904-6b5218e415ad None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:33.966137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacdd7-9dd5-442b-b904-6b5218e415ad None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:33.966539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacdd7-9dd5-442b-b904-6b5218e415ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:33.995564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 831/1664] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:34.001060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0b9f9-25e8-4304-b9a4-caedb8c3633d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:34.027323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d0aacdd7-9dd5-442b-b904-6b5218e415ad None None] MFA Rules not processed for user `06ffd2170c2243eab4511fced8d67ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:34.029802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d0aacdd7-9dd5-442b-b904-6b5218e415ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:34.164116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0b9f9-25e8-4304-b9a4-caedb8c3633d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:34.170698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6908523-68f9-4be6-942a-9c9aa60344bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:34.171575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908523-68f9-4be6-942a-9c9aa60344bf admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:34.172588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908523-68f9-4be6-942a-9c9aa60344bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:34.173010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6908523-68f9-4be6-942a-9c9aa60344bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:34.173896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6908523-68f9-4be6-942a-9c9aa60344bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:34.176394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 834/1665] 10.222.0.69 () {58 vars in 1057 bytes} [Wed May 4 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:03:34.187454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aacdd7-9dd5-442b-b904-6b5218e415ad None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:34.187538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6908523-68f9-4be6-942a-9c9aa60344bf admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:34.199180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aacdd7-9dd5-442b-b904-6b5218e415ad None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:34.213292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ffd2170c2243eab4511fced8d67ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:34.214115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:34.214410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:34.214728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:34.217951 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:34.241881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:34.244764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:34.315598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 832/1666] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:34 2022] POST /identity/v3/projects => generated 365 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:34.318394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 835/1667] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:03:34.321999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6908523-68f9-4be6-942a-9c9aa60344bf admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:34.593037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6908523-68f9-4be6-942a-9c9aa60344bf admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:34.605887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1081e-cdae-49b7-858e-327f3b57fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:34.607656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1081e-cdae-49b7-858e-327f3b57fb88 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:34.608056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1081e-cdae-49b7-858e-327f3b57fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:34.608605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1081e-cdae-49b7-858e-327f3b57fb88 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:34.609625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1081e-cdae-49b7-858e-327f3b57fb88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:34.655644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1081e-cdae-49b7-858e-327f3b57fb88 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:34.818762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 833/1668] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:34 2022] POST /identity/v3/users => generated 289 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:03:34.823254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:34.848692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44adab-c3dd-4f65-9fc9-6c90e78a8085 service placement] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:34.875782 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d761c1-849f-45e3-8b35-115d093f1d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:34.876841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d761c1-849f-45e3-8b35-115d093f1d3b admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:34.880507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d761c1-849f-45e3-8b35-115d093f1d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:34.882386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d761c1-849f-45e3-8b35-115d093f1d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:34.883665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d761c1-849f-45e3-8b35-115d093f1d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:34.886871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d761c1-849f-45e3-8b35-115d093f1d3b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:34.925830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 836/1669] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:34.930103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1081e-cdae-49b7-858e-327f3b57fb88 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:34.948439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1081e-cdae-49b7-858e-327f3b57fb88 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:34.957633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2eb0-6852-4a52-bbd6-93f26906c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:34.958750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2eb0-6852-4a52-bbd6-93f26906c4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:34.959111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2eb0-6852-4a52-bbd6-93f26906c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:34.959446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2eb0-6852-4a52-bbd6-93f26906c4a4 admin admin] PATH_INFO: `/v3/projects/2988157f4918469cb4069140adec060e/users/38a4ca95caf7467684366ed51fb6b083/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:34.994487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2eb0-6852-4a52-bbd6-93f26906c4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2988157f4918469cb4069140adec060e, user_id=38a4ca95caf7467684366ed51fb6b083, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:35.000679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2eb0-6852-4a52-bbd6-93f26906c4a4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:35.313754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 834/1670] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:34 2022] PUT /identity/v3/projects/2988157f4918469cb4069140adec060e/users/38a4ca95caf7467684366ed51fb6b083/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:35.316798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d761c1-849f-45e3-8b35-115d093f1d3b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:35.375872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d761c1-849f-45e3-8b35-115d093f1d3b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:35.532745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b46b4-7e52-4c52-8cd0-2d0547519152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:35.534006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b46b4-7e52-4c52-8cd0-2d0547519152 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:35.534456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b46b4-7e52-4c52-8cd0-2d0547519152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:35.535421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b46b4-7e52-4c52-8cd0-2d0547519152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:35.536465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b46b4-7e52-4c52-8cd0-2d0547519152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:35.539558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b46b4-7e52-4c52-8cd0-2d0547519152 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:35.615268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 837/1671] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:35.619925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2eb0-6852-4a52-bbd6-93f26906c4a4 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:35.639464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2eb0-6852-4a52-bbd6-93f26906c4a4 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:35.647532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badcd7-9f58-4e29-af50-850cd77a84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:35.648569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badcd7-9f58-4e29-af50-850cd77a84d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:35.648853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badcd7-9f58-4e29-af50-850cd77a84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:35.649312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badcd7-9f58-4e29-af50-850cd77a84d0 admin admin] PATH_INFO: `/v3/projects/2988157f4918469cb4069140adec060e/users/38a4ca95caf7467684366ed51fb6b083/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:35.653942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65badcd7-9f58-4e29-af50-850cd77a84d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2988157f4918469cb4069140adec060e, user_id=38a4ca95caf7467684366ed51fb6b083, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:35.657841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65badcd7-9f58-4e29-af50-850cd77a84d0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:35.682047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 835/1672] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:35 2022] PUT /identity/v3/projects/2988157f4918469cb4069140adec060e/users/38a4ca95caf7467684366ed51fb6b083/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:03:35.698601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678b415-3ee2-4e2a-bbb9-b756dacb3a6f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:35.698891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678b415-3ee2-4e2a-bbb9-b756dacb3a6f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:35.699176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678b415-3ee2-4e2a-bbb9-b756dacb3a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:35.803217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8678b415-3ee2-4e2a-bbb9-b756dacb3a6f None None] MFA Rules not processed for user `38a4ca95caf7467684366ed51fb6b083`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:35.804480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8678b415-3ee2-4e2a-bbb9-b756dacb3a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:35.850524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac198-1210-4cd7-95ae-91c46c6c546d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:35.850981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac198-1210-4cd7-95ae-91c46c6c546d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:35.851443 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac198-1210-4cd7-95ae-91c46c6c546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:35.939973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-bdaac198-1210-4cd7-95ae-91c46c6c546d None None] MFA Rules not processed for user `c673e88f380147eaa1718d6a7a80744b`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:35.941225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bdaac198-1210-4cd7-95ae-91c46c6c546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:36.029946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 838/1673] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:36.042726 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678b415-3ee2-4e2a-bbb9-b756dacb3a6f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:36.047200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8678b415-3ee2-4e2a-bbb9-b756dacb3a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:36.105139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 836/1674] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:36.207972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678b415-3ee2-4e2a-bbb9-b756dacb3a6f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:36.213733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:36.215086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:36.218170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:36.218170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:36.235498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:36.237468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:36.256499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 839/1675] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:36.656375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac198-1210-4cd7-95ae-91c46c6c546d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:36.672289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac198-1210-4cd7-95ae-91c46c6c546d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:36.680609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b7047-99df-48ba-bc0f-1f1e028c522b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:36.681542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7047-99df-48ba-bc0f-1f1e028c522b service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:36.681984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7047-99df-48ba-bc0f-1f1e028c522b service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:36.682428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7047-99df-48ba-bc0f-1f1e028c522b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:36.867991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b7047-99df-48ba-bc0f-1f1e028c522b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:36.869926 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b7047-99df-48ba-bc0f-1f1e028c522b service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:36.898478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 837/1676] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:03:39.034242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:39.035837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:39.151131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540dd8a-1d67-4e99-9d7e-191af7db9516 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:39.162730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:39.165198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:39.166297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:39.166770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] PATH_INFO: `/v3/users/8c98eb1f23bc4d6394db8f229e0c3571` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:39.201759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c98eb1f23bc4d6394db8f229e0c3571)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:39.205621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:39.486064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c98eb1f23bc4d6394db8f229e0c3571'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:39.528835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c98eb1f23bc4d6394db8f229e0c3571'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:39.532183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c98eb1f23bc4d6394db8f229e0c3571'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:39.532442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c98eb1f23bc4d6394db8f229e0c3571'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:39.705877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c98eb1f23bc4d6394db8f229e0c3571'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:39.771470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 840/1677] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:03:39 2022] DELETE /identity/v3/users/8c98eb1f23bc4d6394db8f229e0c3571 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:40.894884 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16579b64-96e8-4894-ae23-eff4fff03419 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:40.895902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16579b64-96e8-4894-ae23-eff4fff03419 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:40.896389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16579b64-96e8-4894-ae23-eff4fff03419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:40.954832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-16579b64-96e8-4894-ae23-eff4fff03419 None None] MFA Rules not processed for user `ecb6f1bad8054350a7e22120bfb573c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:40.956178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-16579b64-96e8-4894-ae23-eff4fff03419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.008590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.010100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.140408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 838/1678] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:41.149380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e88a1-3dbb-4452-8bcc-b1e02871d681 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.149380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e88a1-3dbb-4452-8bcc-b1e02871d681 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.149380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e88a1-3dbb-4452-8bcc-b1e02871d681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.192684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3e8e88a1-3dbb-4452-8bcc-b1e02871d681 None None] MFA Rules not processed for user `ecb6f1bad8054350a7e22120bfb573c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:41.195807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d28c7a-0892-4b81-8f9d-8ea56600aead admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.209653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.210942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.213809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.214388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] PATH_INFO: `/v3/projects/9a1aba7a458a47a4890799c2a16f7118` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.216584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1aba7a458a47a4890799c2a16f7118)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.218525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3e8e88a1-3dbb-4452-8bcc-b1e02871d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.221832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.265550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 839/1679] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:41.278232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e88a1-3dbb-4452-8bcc-b1e02871d681 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.283353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3e8e88a1-3dbb-4452-8bcc-b1e02871d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.496450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e88a1-3dbb-4452-8bcc-b1e02871d681 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.511128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1aba7a458a47a4890799c2a16f7118', 'request_id': 'req-71447a96-b1ec-414e-b03d-f731c7e1d57a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.621504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1aba7a458a47a4890799c2a16f7118', 'request_id': 'req-71447a96-b1ec-414e-b03d-f731c7e1d57a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.630775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1aba7a458a47a4890799c2a16f7118', 'request_id': 'req-71447a96-b1ec-414e-b03d-f731c7e1d57a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.670448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] The token cache is being invalidate because project 9a1aba7a458a47a4890799c2a16f7118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:41.670751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.673138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.686187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 841/1680] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:03:41 2022] DELETE /identity/v3/projects/9a1aba7a458a47a4890799c2a16f7118 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:41.688305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.704818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.707295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeff7c-3259-4d21-a009-d15f4cfb24b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.709155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeff7c-3259-4d21-a009-d15f4cfb24b4 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.709155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeff7c-3259-4d21-a009-d15f4cfb24b4 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.709434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeff7c-3259-4d21-a009-d15f4cfb24b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.735634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0beeff7c-3259-4d21-a009-d15f4cfb24b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.968747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71447a96-b1ec-414e-b03d-f731c7e1d57a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.973876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.975396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.976383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.977036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] PATH_INFO: `/v3/users/c673e88f380147eaa1718d6a7a80744b` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.989973 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c673e88f380147eaa1718d6a7a80744b)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.993700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.027300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeff7c-3259-4d21-a009-d15f4cfb24b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.031032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeff7c-3259-4d21-a009-d15f4cfb24b4 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.057939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 840/1681] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:03:42.282126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa45b-19c2-4fa9-b232-5e10b2fad7a5 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.282683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa45b-19c2-4fa9-b232-5e10b2fad7a5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.282978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa45b-19c2-4fa9-b232-5e10b2fad7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.332730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-698aa45b-19c2-4fa9-b232-5e10b2fad7a5 None None] MFA Rules not processed for user `0ca157aeabbb4f9da8475ca002dd0239`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:42.334853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-698aa45b-19c2-4fa9-b232-5e10b2fad7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:42.364688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c673e88f380147eaa1718d6a7a80744b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:42.454828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c673e88f380147eaa1718d6a7a80744b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:42.455639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c673e88f380147eaa1718d6a7a80744b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:42.473395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c673e88f380147eaa1718d6a7a80744b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:42.490691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 841/1682] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:42.602664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b616c10f-4199-403e-9532-26b62d8289d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c673e88f380147eaa1718d6a7a80744b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:42.623717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 842/1683] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:03:41 2022] DELETE /identity/v3/users/c673e88f380147eaa1718d6a7a80744b => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:43.192908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aa45b-19c2-4fa9-b232-5e10b2fad7a5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:43.206606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aa45b-19c2-4fa9-b232-5e10b2fad7a5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:43.264273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5bfd-9f68-477f-a189-d6a369e0590e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:43.264565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5bfd-9f68-477f-a189-d6a369e0590e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:43.265131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5bfd-9f68-477f-a189-d6a369e0590e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:43.341160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1f3b5bfd-9f68-477f-a189-d6a369e0590e None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:43.341160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1f3b5bfd-9f68-477f-a189-d6a369e0590e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:43.363271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:43.364151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:43.364431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:43.364704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] PATH_INFO: `/v3/projects/5ccc6410376f4e18a855f227ca4be07d` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:43.365990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccc6410376f4e18a855f227ca4be07d)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:43.367020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: WARNING py.warnings [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 14:03:43.367020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: warnings.warn(msg) May 04 14:03:43.367020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: May 04 14:03:43.368260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:43.451536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 843/1684] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:43.622404 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccc6410376f4e18a855f227ca4be07d', 'request_id': 'req-9ac1af9e-132b-4379-b11b-8dcb6a77b576'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.781784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccc6410376f4e18a855f227ca4be07d', 'request_id': 'req-9ac1af9e-132b-4379-b11b-8dcb6a77b576'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.791681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccc6410376f4e18a855f227ca4be07d', 'request_id': 'req-9ac1af9e-132b-4379-b11b-8dcb6a77b576'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.850082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] The token cache is being invalidate because project 5ccc6410376f4e18a855f227ca4be07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:43.853013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.853013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9ac1af9e-132b-4379-b11b-8dcb6a77b576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.855568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5bfd-9f68-477f-a189-d6a369e0590e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:43.857948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1f3b5bfd-9f68-477f-a189-d6a369e0590e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:43.862628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 842/1685] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:03:43 2022] DELETE /identity/v3/projects/5ccc6410376f4e18a855f227ca4be07d => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:43.865595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e98c-8c44-49b1-9033-499595a5bb68 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:43.865889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e98c-8c44-49b1-9033-499595a5bb68 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:43.866171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e98c-8c44-49b1-9033-499595a5bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:43.915094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a9b2e98c-8c44-49b1-9033-499595a5bb68 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:43.916627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a9b2e98c-8c44-49b1-9033-499595a5bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.032159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5bfd-9f68-477f-a189-d6a369e0590e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.150093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 843/1686] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:44.151353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2e98c-8c44-49b1-9033-499595a5bb68 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.153718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a9b2e98c-8c44-49b1-9033-499595a5bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.191166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96768aac-6076-4438-a71c-520dd1b7793d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.192087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96768aac-6076-4438-a71c-520dd1b7793d service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.193954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96768aac-6076-4438-a71c-520dd1b7793d service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.194377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96768aac-6076-4438-a71c-520dd1b7793d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.198779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-96768aac-6076-4438-a71c-520dd1b7793d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.280589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2e98c-8c44-49b1-9033-499595a5bb68 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.287345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96768aac-6076-4438-a71c-520dd1b7793d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.289161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96768aac-6076-4438-a71c-520dd1b7793d service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.301622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 844/1687] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:03:44.304181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c146d-7c30-46ff-837e-706bc3a580d9 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.304619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c146d-7c30-46ff-837e-706bc3a580d9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.305031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c146d-7c30-46ff-837e-706bc3a580d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.326636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.328171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.329204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.329667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.332554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.344733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-528c146d-7c30-46ff-837e-706bc3a580d9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:44.346192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-528c146d-7c30-46ff-837e-706bc3a580d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.356025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 845/1688] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:44.364006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c146d-7c30-46ff-837e-706bc3a580d9 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.375366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c146d-7c30-46ff-837e-706bc3a580d9 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.381497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.382427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.382853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.383300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.384261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:44.384747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.391316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.419319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 846/1689] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:44.423501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.438066 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a44fc-0acf-4fdf-b8a8-d66ce6c6e196 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.457662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511345e9-6b80-4edb-965c-d78923c0bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.459128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511345e9-6b80-4edb-965c-d78923c0bbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.459463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.459750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511345e9-6b80-4edb-965c-d78923c0bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.460174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511345e9-6b80-4edb-965c-d78923c0bbb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.461123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.461353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511345e9-6b80-4edb-965c-d78923c0bbb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.464170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511345e9-6b80-4edb-965c-d78923c0bbb8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.486260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 844/1690] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:03:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:03:44.606755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 847/1691] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:44 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:03:44.610879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.639802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490633e-8bed-4ea5-8147-b60c73e6f04d service swift] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.835608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee1091-1ffd-4d22-bd8d-7642786a89c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.838521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1091-1ffd-4d22-bd8d-7642786a89c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.840092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1091-1ffd-4d22-bd8d-7642786a89c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.842316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee1091-1ffd-4d22-bd8d-7642786a89c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.843205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee1091-1ffd-4d22-bd8d-7642786a89c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.858501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee1091-1ffd-4d22-bd8d-7642786a89c9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.982573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 845/1692] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:44 2022] POST /identity/v3/users => generated 294 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:44.983646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511345e9-6b80-4edb-965c-d78923c0bbb8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:45.003554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511345e9-6b80-4edb-965c-d78923c0bbb8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:45.040017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6bd50-7a91-4b90-a493-f302e55da516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:45.040744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6bd50-7a91-4b90-a493-f302e55da516 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:45.041032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6bd50-7a91-4b90-a493-f302e55da516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:45.041341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6bd50-7a91-4b90-a493-f302e55da516 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:45.042070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6bd50-7a91-4b90-a493-f302e55da516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:45.043978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6bd50-7a91-4b90-a493-f302e55da516 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:45.105779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 848/1693] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:45.108954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee1091-1ffd-4d22-bd8d-7642786a89c9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:45.133649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee1091-1ffd-4d22-bd8d-7642786a89c9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:45.169913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d7c18-bfcd-4070-ae9e-fbf9e61f6dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:45.170647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7c18-bfcd-4070-ae9e-fbf9e61f6dbc admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:45.170936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7c18-bfcd-4070-ae9e-fbf9e61f6dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:45.171232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7c18-bfcd-4070-ae9e-fbf9e61f6dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:45.171995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d7c18-bfcd-4070-ae9e-fbf9e61f6dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:45.186930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d7c18-bfcd-4070-ae9e-fbf9e61f6dbc admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:45.239423 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6bd50-7a91-4b90-a493-f302e55da516 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:45.263787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 846/1694] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:45.275750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6bd50-7a91-4b90-a493-f302e55da516 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:45.334293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaac22c-615b-44a9-85eb-2d4382538bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:45.348231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaac22c-615b-44a9-85eb-2d4382538bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:45.348531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaac22c-615b-44a9-85eb-2d4382538bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:45.374190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaac22c-615b-44a9-85eb-2d4382538bd5 admin admin] PATH_INFO: `/v3/projects/5c5268bd7ab54f548c2d789f69092e70/users/f0ddf5a4a37d41be8ce9516f8504fd7c/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:45.466398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaac22c-615b-44a9-85eb-2d4382538bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5268bd7ab54f548c2d789f69092e70, user_id=f0ddf5a4a37d41be8ce9516f8504fd7c, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:45.479607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaac22c-615b-44a9-85eb-2d4382538bd5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:45.576738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 849/1695] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:45 2022] PUT /identity/v3/projects/5c5268bd7ab54f548c2d789f69092e70/users/f0ddf5a4a37d41be8ce9516f8504fd7c/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:45.593480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f3e7-5305-4678-8fb6-c96096b067b3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:45.594022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f3e7-5305-4678-8fb6-c96096b067b3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:45.594235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f3e7-5305-4678-8fb6-c96096b067b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:45.734820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0099-f3b9-4818-ba8b-1a5cb6f943b4 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:45.735479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0099-f3b9-4818-ba8b-1a5cb6f943b4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:45.736035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0099-f3b9-4818-ba8b-1a5cb6f943b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:45.752184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-bdd0f3e7-5305-4678-8fb6-c96096b067b3 None None] MFA Rules not processed for user `f0ddf5a4a37d41be8ce9516f8504fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:45.756539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bdd0f3e7-5305-4678-8fb6-c96096b067b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:45.782616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-237b0099-f3b9-4818-ba8b-1a5cb6f943b4 None None] MFA Rules not processed for user `ecb6f1bad8054350a7e22120bfb573c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:45.784220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-237b0099-f3b9-4818-ba8b-1a5cb6f943b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:45.937331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 850/1696] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:03:45.938355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b0099-f3b9-4818-ba8b-1a5cb6f943b4 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:45.950459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-237b0099-f3b9-4818-ba8b-1a5cb6f943b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:46.013393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 847/1697] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:46.019881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0f3e7-5305-4678-8fb6-c96096b067b3 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:46.161810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b0099-f3b9-4818-ba8b-1a5cb6f943b4 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:46.192718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:46.194973 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:46.196666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:46.198543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] PATH_INFO: `/v3/users/0941f73a00234e489a34aa58e813cf35` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:46.206465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0941f73a00234e489a34aa58e813cf35)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:46.213642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:46.255265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0f3e7-5305-4678-8fb6-c96096b067b3 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:46.286893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36f71-3a9f-4356-9193-b4a42a04ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:46.292438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36f71-3a9f-4356-9193-b4a42a04ea37 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:46.294984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36f71-3a9f-4356-9193-b4a42a04ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:46.299305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36f71-3a9f-4356-9193-b4a42a04ea37 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:46.299305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a36f71-3a9f-4356-9193-b4a42a04ea37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:46.313500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a36f71-3a9f-4356-9193-b4a42a04ea37 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:46.457339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 848/1698] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:46 2022] POST /identity/v3/projects => generated 387 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:46.460757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36f71-3a9f-4356-9193-b4a42a04ea37 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:46.751020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0941f73a00234e489a34aa58e813cf35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:46.751681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36f71-3a9f-4356-9193-b4a42a04ea37 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:46.752042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0941f73a00234e489a34aa58e813cf35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:46.752042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0941f73a00234e489a34aa58e813cf35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:46.752171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac65913-82e7-479e-bb86-155b757dc504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:46.752255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0941f73a00234e489a34aa58e813cf35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:46.757145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac65913-82e7-479e-bb86-155b757dc504 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:46.759031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac65913-82e7-479e-bb86-155b757dc504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:46.760370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac65913-82e7-479e-bb86-155b757dc504 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:46.763124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac65913-82e7-479e-bb86-155b757dc504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:46.778592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac65913-82e7-479e-bb86-155b757dc504 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:47.160255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-655eaaa9-c710-40e8-93f0-1680a75a4eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0941f73a00234e489a34aa58e813cf35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:47.167660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 849/1699] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:46 2022] POST /identity/v3/users => generated 294 bytes in 707 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:47.169209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426962-4356-4fe3-b7b3-3448ad019d09 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:47.169627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426962-4356-4fe3-b7b3-3448ad019d09 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:47.169895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426962-4356-4fe3-b7b3-3448ad019d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:47.238246 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 851/1700] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:03:45 2022] DELETE /identity/v3/users/0941f73a00234e489a34aa58e813cf35 => generated 0 bytes in 1298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:47.239896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3772-a4a2-4dde-a05f-e13546ef6511 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:47.241701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3772-a4a2-4dde-a05f-e13546ef6511 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:47.242816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d3772-a4a2-4dde-a05f-e13546ef6511 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:47.248063 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 852/1701] 10.222.0.69 () {54 vars in 912 bytes} [Wed May 4 14:03:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:03:47.258135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d3772-a4a2-4dde-a05f-e13546ef6511 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:47.270324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-919d3772-a4a2-4dde-a05f-e13546ef6511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:47.308955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-73426962-4356-4fe3-b7b3-3448ad019d09 None None] MFA Rules not processed for user `b32e32eb1444401b9b7d8ab3228bdfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:47.318084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-73426962-4356-4fe3-b7b3-3448ad019d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:47.462043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d3772-a4a2-4dde-a05f-e13546ef6511 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:47.480765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974612-a7ff-43db-a8af-cafc850ba3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:47.482226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974612-a7ff-43db-a8af-cafc850ba3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:47.482796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974612-a7ff-43db-a8af-cafc850ba3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:47.489573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974612-a7ff-43db-a8af-cafc850ba3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:47.490732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0974612-a7ff-43db-a8af-cafc850ba3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:47.492953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0974612-a7ff-43db-a8af-cafc850ba3e9 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:47.562385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 853/1702] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:47.564308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c76b1-11c9-4c97-b0a2-a33f8aaf2cdf None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:47.572765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c76b1-11c9-4c97-b0a2-a33f8aaf2cdf None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:47.573434 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c76b1-11c9-4c97-b0a2-a33f8aaf2cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:47.595659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 850/1703] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:47.597392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038557d-fe63-477f-9701-e942fb6739e0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:47.597825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038557d-fe63-477f-9701-e942fb6739e0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:47.598442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038557d-fe63-477f-9701-e942fb6739e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:47.654752 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-2038557d-fe63-477f-9701-e942fb6739e0 None None] MFA Rules not processed for user `378bf86fc54142ee85dc16cce3664978`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:47.656647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2038557d-fe63-477f-9701-e942fb6739e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:47.658237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-fb9c76b1-11c9-4c97-b0a2-a33f8aaf2cdf None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:47.659545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-fb9c76b1-11c9-4c97-b0a2-a33f8aaf2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:47.694931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 854/1704] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:47.695845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c76b1-11c9-4c97-b0a2-a33f8aaf2cdf None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:47.733662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c76b1-11c9-4c97-b0a2-a33f8aaf2cdf None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:47.758079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:47.761364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:47.763145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:47.763644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:47.765473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:47.770876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:47.846455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 855/1705] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:47.849833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:47.853031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:47.876413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 851/1706] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:47.877386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038557d-fe63-477f-9701-e942fb6739e0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:47.937466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038557d-fe63-477f-9701-e942fb6739e0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:47.968682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:47.974139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:47.975074 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:47.975365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] PATH_INFO: `/v3/projects/71cb39671bfc4c4484898a7e82df3213/users/10e3972e46ba450182da0834989c0115/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:48.033434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cb39671bfc4c4484898a7e82df3213, user_id=10e3972e46ba450182da0834989c0115, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:48.039963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:48.059729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a2c82-0d88-47e3-963c-0b626924f824 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:48.080129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce1935-b11a-4463-8ded-aabbaa0b000a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:48.083116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce1935-b11a-4463-8ded-aabbaa0b000a service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:48.083859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce1935-b11a-4463-8ded-aabbaa0b000a service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:48.084375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce1935-b11a-4463-8ded-aabbaa0b000a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:48.114304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce1935-b11a-4463-8ded-aabbaa0b000a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:48.127341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 852/1707] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:47 2022] PUT /identity/v3/projects/71cb39671bfc4c4484898a7e82df3213/users/10e3972e46ba450182da0834989c0115/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:48.129432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce1935-b11a-4463-8ded-aabbaa0b000a service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:48.134849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:48.134849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:48.171406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 856/1708] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:48.184250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcfb7-add8-4a5e-a233-88c4d75b667e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:48.187153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcfb7-add8-4a5e-a233-88c4d75b667e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:48.187469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bcfb7-add8-4a5e-a233-88c4d75b667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:48.312289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b57bcfb7-add8-4a5e-a233-88c4d75b667e None None] MFA Rules not processed for user `10e3972e46ba450182da0834989c0115`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:48.322713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b57bcfb7-add8-4a5e-a233-88c4d75b667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:48.393797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5966-d094-4d4f-8564-071af9f73fb2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:48.414224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:48.414224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:48.414224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:48.414224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:48.449355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:48.465272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:48.516806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 853/1709] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:48.520041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:48.529882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:48.619905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 857/1710] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:48.621374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687930-577f-4cd2-affe-4ebf5a31cb06 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:48.622234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687930-577f-4cd2-affe-4ebf5a31cb06 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:48.623041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89687930-577f-4cd2-affe-4ebf5a31cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:48.679163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-89687930-577f-4cd2-affe-4ebf5a31cb06 None None] MFA Rules not processed for user `378bf86fc54142ee85dc16cce3664978`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:48.681564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-89687930-577f-4cd2-affe-4ebf5a31cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:48.708460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 858/1711] 10.222.0.58 () {58 vars in 1015 bytes} [Wed May 4 14:03:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:48.709489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89687930-577f-4cd2-affe-4ebf5a31cb06 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:48.762106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e707a6-94a0-4009-93a8-b9f7d610938d service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:48.780591 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454e890-a1a1-49b3-992f-7a3e1f81a12d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:48.781660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454e890-a1a1-49b3-992f-7a3e1f81a12d service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:48.783153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454e890-a1a1-49b3-992f-7a3e1f81a12d service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:48.783480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454e890-a1a1-49b3-992f-7a3e1f81a12d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:48.911306 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89687930-577f-4cd2-affe-4ebf5a31cb06 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:48.925545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c61c93-0f82-44ad-b82e-2bf51b5c0f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:48.927251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c61c93-0f82-44ad-b82e-2bf51b5c0f14 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:48.927822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c61c93-0f82-44ad-b82e-2bf51b5c0f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:48.928430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c61c93-0f82-44ad-b82e-2bf51b5c0f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:48.929945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c61c93-0f82-44ad-b82e-2bf51b5c0f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:48.937699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c61c93-0f82-44ad-b82e-2bf51b5c0f14 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:48.977309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454e890-a1a1-49b3-992f-7a3e1f81a12d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:48.984468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454e890-a1a1-49b3-992f-7a3e1f81a12d service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:49.003075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 854/1712] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:49.004811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454e890-a1a1-49b3-992f-7a3e1f81a12d service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:49.022023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454e890-a1a1-49b3-992f-7a3e1f81a12d service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:49.031152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:49.034343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:49.035713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:49.036007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:49.064643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:49.089192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 859/1713] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:48 2022] POST /identity/v3/projects => generated 385 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:49.094882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c61c93-0f82-44ad-b82e-2bf51b5c0f14 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:49.096013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:49.158741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 855/1714] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:49.266661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:49.274842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:49.334946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6748f-0287-44d0-9c74-60341933a544 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:49.361302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c61c93-0f82-44ad-b82e-2bf51b5c0f14 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:49.361406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:49.361406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:49.361406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:49.361406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] PATH_INFO: `/v3/projects/8f2eb3020e3141a1a7489ad69f109e83` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:49.366418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2eb3020e3141a1a7489ad69f109e83)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:49.367424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152931a7-0cdf-4470-8390-e8cd41efa535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:49.368220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152931a7-0cdf-4470-8390-e8cd41efa535 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:49.368631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152931a7-0cdf-4470-8390-e8cd41efa535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:49.369006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152931a7-0cdf-4470-8390-e8cd41efa535 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:49.370239 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152931a7-0cdf-4470-8390-e8cd41efa535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:49.372782 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152931a7-0cdf-4470-8390-e8cd41efa535 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:49.374453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:49.532509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 860/1715] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:49 2022] POST /identity/v3/users => generated 299 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:49.538041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152931a7-0cdf-4470-8390-e8cd41efa535 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:49.557803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152931a7-0cdf-4470-8390-e8cd41efa535 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:49.570899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910b9a0-9fbf-48fe-a775-89468c072ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:49.570899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b9a0-9fbf-48fe-a775-89468c072ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:49.579519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b9a0-9fbf-48fe-a775-89468c072ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:49.579519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b9a0-9fbf-48fe-a775-89468c072ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:49.579519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910b9a0-9fbf-48fe-a775-89468c072ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:49.579519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910b9a0-9fbf-48fe-a775-89468c072ad9 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:49.611543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 861/1716] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:03:49.613700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910b9a0-9fbf-48fe-a775-89468c072ad9 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:49.640422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910b9a0-9fbf-48fe-a775-89468c072ad9 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:49.706412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2eb3020e3141a1a7489ad69f109e83', 'request_id': 'req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:49.782491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2eb3020e3141a1a7489ad69f109e83', 'request_id': 'req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:49.798546 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2eb3020e3141a1a7489ad69f109e83', 'request_id': 'req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:49.844284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] The token cache is being invalidate because project 8f2eb3020e3141a1a7489ad69f109e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:49.845673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:49.846735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-276cd191-bd3b-4e5c-adb6-5d2703a27a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:49.849010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 856/1717] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:03:49 2022] DELETE /identity/v3/projects/8f2eb3020e3141a1a7489ad69f109e83 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:49.854369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a357e-257b-4f57-9c85-1e41bc725fe3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:49.854918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a357e-257b-4f57-9c85-1e41bc725fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:49.855429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a357e-257b-4f57-9c85-1e41bc725fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:49.863751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:49.866859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:49.904936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:49.905491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] PATH_INFO: `/v3/projects/de2792c6ae8b4479b99da841718d1195/users/1e23875ffb144ad2b9558d75d42f9a94/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:49.954759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-c42a357e-257b-4f57-9c85-1e41bc725fe3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:49.957561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c42a357e-257b-4f57-9c85-1e41bc725fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:49.985159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 857/1718] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:49.994040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b786373-0377-444d-a0b8-b0f4213893d2 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:49.994797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b786373-0377-444d-a0b8-b0f4213893d2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:49.995329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b786373-0377-444d-a0b8-b0f4213893d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:50.002314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2792c6ae8b4479b99da841718d1195, user_id=1e23875ffb144ad2b9558d75d42f9a94, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:50.006567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:50.054512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3b786373-0377-444d-a0b8-b0f4213893d2 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:50.056058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3b786373-0377-444d-a0b8-b0f4213893d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:50.081131 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 858/1719] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:50.084602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b786373-0377-444d-a0b8-b0f4213893d2 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:50.119647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 862/1720] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:49 2022] PUT /identity/v3/projects/de2792c6ae8b4479b99da841718d1195/users/1e23875ffb144ad2b9558d75d42f9a94/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:50.123006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:50.127296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b786373-0377-444d-a0b8-b0f4213893d2 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:50.134432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:50.311814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:50.312389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:50.312744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:50.317098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:50.320114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:50.322465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:50.326533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:50.363497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e8cb0-241d-4d2a-8d53-aaf559f77610 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:50.372707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 859/1721] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:50.375392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eca8c-8804-4805-9d2b-9db03bebf1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:50.375855 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eca8c-8804-4805-9d2b-9db03bebf1ff admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:50.376491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eca8c-8804-4805-9d2b-9db03bebf1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:50.376491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eca8c-8804-4805-9d2b-9db03bebf1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:50.381420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eca8c-8804-4805-9d2b-9db03bebf1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:50.381420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eca8c-8804-4805-9d2b-9db03bebf1ff admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:50.381598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:50.407355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8f18-6b63-4f1a-a0d3-49a22447325c admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:50.423313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 863/1722] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:03:50.435756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eca8c-8804-4805-9d2b-9db03bebf1ff admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:50.438293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b8cf-3ae6-4eaa-88cd-db7170fa3f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:50.439006 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b8cf-3ae6-4eaa-88cd-db7170fa3f32 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:50.441027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b8cf-3ae6-4eaa-88cd-db7170fa3f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:50.441421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b8cf-3ae6-4eaa-88cd-db7170fa3f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:50.447509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b8cf-3ae6-4eaa-88cd-db7170fa3f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:50.449668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b8cf-3ae6-4eaa-88cd-db7170fa3f32 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:50.461976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eca8c-8804-4805-9d2b-9db03bebf1ff admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:50.476557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc992e-da8c-40fa-af54-2dc843f899cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:50.478815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc992e-da8c-40fa-af54-2dc843f899cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:50.479098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc992e-da8c-40fa-af54-2dc843f899cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:50.479382 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc992e-da8c-40fa-af54-2dc843f899cc admin admin] PATH_INFO: `/v3/projects/de2792c6ae8b4479b99da841718d1195/users/1e23875ffb144ad2b9558d75d42f9a94/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:50.490535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc992e-da8c-40fa-af54-2dc843f899cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2792c6ae8b4479b99da841718d1195, user_id=1e23875ffb144ad2b9558d75d42f9a94, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:50.498645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc992e-da8c-40fa-af54-2dc843f899cc admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:50.528517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 864/1723] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:50 2022] PUT /identity/v3/projects/de2792c6ae8b4479b99da841718d1195/users/1e23875ffb144ad2b9558d75d42f9a94/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:50.543238 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1edd3-7def-4a7e-a228-fa2d2eea477a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:50.544096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1edd3-7def-4a7e-a228-fa2d2eea477a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:50.544349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1edd3-7def-4a7e-a228-fa2d2eea477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:50.585987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 860/1724] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:03:50 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:50.591276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b8cf-3ae6-4eaa-88cd-db7170fa3f32 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:50.622599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a7c1edd3-7def-4a7e-a228-fa2d2eea477a None None] MFA Rules not processed for user `1e23875ffb144ad2b9558d75d42f9a94`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:50.622599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a7c1edd3-7def-4a7e-a228-fa2d2eea477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:50.873344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 865/1725] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:50.883548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1edd3-7def-4a7e-a228-fa2d2eea477a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:50.885026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a7c1edd3-7def-4a7e-a228-fa2d2eea477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:51.058533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b8cf-3ae6-4eaa-88cd-db7170fa3f32 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:51.071704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0fc71-6a9c-453d-b6d1-671500ceada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:51.078878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0fc71-6a9c-453d-b6d1-671500ceada4 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:51.079265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0fc71-6a9c-453d-b6d1-671500ceada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:51.079512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0fc71-6a9c-453d-b6d1-671500ceada4 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:51.082492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0fc71-6a9c-453d-b6d1-671500ceada4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:51.086419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0fc71-6a9c-453d-b6d1-671500ceada4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:51.107466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1edd3-7def-4a7e-a228-fa2d2eea477a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:51.123037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda4da-d357-4751-9fc9-dcf999438015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:51.123037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda4da-d357-4751-9fc9-dcf999438015 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:51.123037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda4da-d357-4751-9fc9-dcf999438015 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:51.123037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda4da-d357-4751-9fc9-dcf999438015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:51.126937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afda4da-d357-4751-9fc9-dcf999438015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:51.129018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afda4da-d357-4751-9fc9-dcf999438015 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:51.160393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 866/1726] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:51.291229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 861/1727] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:03:50 2022] POST /identity/v3/users => generated 283 bytes in 701 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:51.297558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda4da-d357-4751-9fc9-dcf999438015 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:51.318864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda4da-d357-4751-9fc9-dcf999438015 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:51.338780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948265-f66a-48a9-a491-3824cac95852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:51.339406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948265-f66a-48a9-a491-3824cac95852 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:51.341367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948265-f66a-48a9-a491-3824cac95852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:51.342490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948265-f66a-48a9-a491-3824cac95852 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:51.349531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11948265-f66a-48a9-a491-3824cac95852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:51.353766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11948265-f66a-48a9-a491-3824cac95852 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:51.419093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 867/1728] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:51.421502 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0fc71-6a9c-453d-b6d1-671500ceada4 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:51.448173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0fc71-6a9c-453d-b6d1-671500ceada4 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:51.475170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49073fe8-6ded-47d0-b74f-5eda1aec6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:51.476012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49073fe8-6ded-47d0-b74f-5eda1aec6123 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:51.476297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49073fe8-6ded-47d0-b74f-5eda1aec6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:51.478792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49073fe8-6ded-47d0-b74f-5eda1aec6123 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:51.478792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49073fe8-6ded-47d0-b74f-5eda1aec6123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:51.478980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49073fe8-6ded-47d0-b74f-5eda1aec6123 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:51.509740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 862/1729] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:51.519468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948265-f66a-48a9-a491-3824cac95852 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:51.542722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948265-f66a-48a9-a491-3824cac95852 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:51.573358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:51.579976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:51.582298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:51.582298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] PATH_INFO: `/v3/projects/0e88b097e535429cb009924556cdb6f0/users/a5f6e43aba92497a9dc09da7daf06812/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:51.675664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e88b097e535429cb009924556cdb6f0, user_id=a5f6e43aba92497a9dc09da7daf06812, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:51.678441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:51.909288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 868/1730] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:03:51 2022] PUT /identity/v3/projects/0e88b097e535429cb009924556cdb6f0/users/a5f6e43aba92497a9dc09da7daf06812/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:51.911002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd78b-bb9e-4dee-8439-dff8265980f9 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:51.911288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd78b-bb9e-4dee-8439-dff8265980f9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:51.911564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd78b-bb9e-4dee-8439-dff8265980f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:52.004021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-994fd78b-bb9e-4dee-8439-dff8265980f9 None None] MFA Rules not processed for user `a5f6e43aba92497a9dc09da7daf06812`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:52.006068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-994fd78b-bb9e-4dee-8439-dff8265980f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:52.216650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 863/1731] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:52.409326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:52.412413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:52.739004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22164d32-1dc7-4c9d-a18b-fd2019e393ec admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:52.774421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0380394-c73a-4fed-8265-7b9d3ab98b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:52.775476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0380394-c73a-4fed-8265-7b9d3ab98b24 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:52.778092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0380394-c73a-4fed-8265-7b9d3ab98b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:52.779020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0380394-c73a-4fed-8265-7b9d3ab98b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:52.799642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0380394-c73a-4fed-8265-7b9d3ab98b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:52.801178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0380394-c73a-4fed-8265-7b9d3ab98b24 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:52.829008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 869/1732] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:54.237319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd78b-bb9e-4dee-8439-dff8265980f9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:54.259831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb9db-c8a2-4869-b91c-71696645f7a9 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:54.264221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb9db-c8a2-4869-b91c-71696645f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:54.264516 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb9db-c8a2-4869-b91c-71696645f7a9 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:54.270280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 870/1733] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:03:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:03:54.271117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd78b-bb9e-4dee-8439-dff8265980f9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:54.302051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:54.304392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:54.305747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:54.307324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:54.317173 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5af0-c995-49be-8dd7-0939baedf32a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:54.317490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5af0-c995-49be-8dd7-0939baedf32a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:54.317778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5af0-c995-49be-8dd7-0939baedf32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:54.319651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:54.371520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-420e5af0-c995-49be-8dd7-0939baedf32a None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:54.377166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-420e5af0-c995-49be-8dd7-0939baedf32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:54.426244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:54.429023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:54.469621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 864/1734] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:54.593809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 871/1735] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:03:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:54.651366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:54.654203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:54.693608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e5af0-c995-49be-8dd7-0939baedf32a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:54.696275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-420e5af0-c995-49be-8dd7-0939baedf32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:54.706030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca3f39-da58-4f10-bf5a-36f05b6431da service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:54.725679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d9cbf-909d-4821-b3f3-d208f7cc53f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:54.727475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9cbf-909d-4821-b3f3-d208f7cc53f4 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:54.729193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9cbf-909d-4821-b3f3-d208f7cc53f4 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:54.729747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9cbf-909d-4821-b3f3-d208f7cc53f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:54.751865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d9cbf-909d-4821-b3f3-d208f7cc53f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:54.764373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d9cbf-909d-4821-b3f3-d208f7cc53f4 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:54.796653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 865/1736] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:55.002513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e5af0-c995-49be-8dd7-0939baedf32a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:55.009588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:55.010859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:55.011362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:55.011852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] PATH_INFO: `/v3/users/8294fe40bbf9486bbbd3b23561621469` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:55.014940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8294fe40bbf9486bbbd3b23561621469)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:55.017308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:55.368870 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8294fe40bbf9486bbbd3b23561621469'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:55.386170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8294fe40bbf9486bbbd3b23561621469'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:55.387192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8294fe40bbf9486bbbd3b23561621469'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:55.389029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8294fe40bbf9486bbbd3b23561621469'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:55.507063 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8294fe40bbf9486bbbd3b23561621469'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:55.538390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 872/1737] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:03:54 2022] DELETE /identity/v3/users/8294fe40bbf9486bbbd3b23561621469 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:03:55.542271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ac86-a8c0-4a7a-9927-b281fa201861 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:55.543205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ac86-a8c0-4a7a-9927-b281fa201861 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:55.544314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ac86-a8c0-4a7a-9927-b281fa201861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:55.589023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ff35ac86-a8c0-4a7a-9927-b281fa201861 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:55.593567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ff35ac86-a8c0-4a7a-9927-b281fa201861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:55.721348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 866/1738] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:03:55.769190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:55.770765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:55.993814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b0fc-9883-4438-8c02-7aae990c0ae7 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:56.008235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8ddf3-f40e-4fa8-a55b-1208e623ef50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:56.010070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8ddf3-f40e-4fa8-a55b-1208e623ef50 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:56.011891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8ddf3-f40e-4fa8-a55b-1208e623ef50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:56.013114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8ddf3-f40e-4fa8-a55b-1208e623ef50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:56.061402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8ddf3-f40e-4fa8-a55b-1208e623ef50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:56.066451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8ddf3-f40e-4fa8-a55b-1208e623ef50 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:56.086882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 873/1739] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:56.297974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550342d1-3cae-45ee-abc2-93b4b09f30d0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:56.298566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550342d1-3cae-45ee-abc2-93b4b09f30d0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:56.298956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550342d1-3cae-45ee-abc2-93b4b09f30d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:56.334359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-550342d1-3cae-45ee-abc2-93b4b09f30d0 None None] MFA Rules not processed for user `0ca157aeabbb4f9da8475ca002dd0239`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:56.335764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-550342d1-3cae-45ee-abc2-93b4b09f30d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:56.446133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 867/1740] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:58.611823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3522495-e2e4-4132-b49a-dc140b33d04d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:58.612359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3522495-e2e4-4132-b49a-dc140b33d04d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:58.612613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3522495-e2e4-4132-b49a-dc140b33d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:58.662676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b3522495-e2e4-4132-b49a-dc140b33d04d None None] MFA Rules not processed for user `b32e32eb1444401b9b7d8ab3228bdfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:58.663918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b3522495-e2e4-4132-b49a-dc140b33d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:58.745291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550342d1-3cae-45ee-abc2-93b4b09f30d0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:58.747788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-550342d1-3cae-45ee-abc2-93b4b09f30d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:58.789096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550342d1-3cae-45ee-abc2-93b4b09f30d0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:58.804231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:58.806233 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:58.806876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:58.807636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] PATH_INFO: `/v3/projects/294559712ad14745a10c85f672d8d380` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:58.812113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294559712ad14745a10c85f672d8d380)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:58.820789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:58.826347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 874/1741] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:03:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:58.995759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294559712ad14745a10c85f672d8d380', 'request_id': 'req-6efe9e17-59f5-47c2-8343-16d45e1dacc6'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:59.112128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294559712ad14745a10c85f672d8d380', 'request_id': 'req-6efe9e17-59f5-47c2-8343-16d45e1dacc6'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:59.134338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294559712ad14745a10c85f672d8d380', 'request_id': 'req-6efe9e17-59f5-47c2-8343-16d45e1dacc6'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:59.191955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] The token cache is being invalidate because project 294559712ad14745a10c85f672d8d380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:59.195160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:59.202906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6efe9e17-59f5-47c2-8343-16d45e1dacc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:59.210119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 868/1742] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:03:58 2022] DELETE /identity/v3/projects/294559712ad14745a10c85f672d8d380 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:59.214229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3522495-e2e4-4132-b49a-dc140b33d04d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:59.236549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3522495-e2e4-4132-b49a-dc140b33d04d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:59.465543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:59.467133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:59.467133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:59.472261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] PATH_INFO: `/v3/users/38a4ca95caf7467684366ed51fb6b083` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:59.475420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a4ca95caf7467684366ed51fb6b083)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:59.477829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:59.904332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a4ca95caf7467684366ed51fb6b083'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:59.927206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a4ca95caf7467684366ed51fb6b083'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:59.927206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a4ca95caf7467684366ed51fb6b083'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:59.927206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a4ca95caf7467684366ed51fb6b083'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:00.078834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2763165f-c332-428f-bc76-e8a35f777591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a4ca95caf7467684366ed51fb6b083'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:00.116550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 875/1743] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:03:59 2022] DELETE /identity/v3/users/38a4ca95caf7467684366ed51fb6b083 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:00.708780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8cfa7-91f2-4bb9-b461-aef0bac35280 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:00.709756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8cfa7-91f2-4bb9-b461-aef0bac35280 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:00.710241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8cfa7-91f2-4bb9-b461-aef0bac35280 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:00.711835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 869/1744] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:04:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:04:00.723597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b72f0-0cfb-45b5-9022-fc6be4f1eea4 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:00.723885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b72f0-0cfb-45b5-9022-fc6be4f1eea4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:00.724508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b72f0-0cfb-45b5-9022-fc6be4f1eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:00.874160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3c3b72f0-0cfb-45b5-9022-fc6be4f1eea4 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:00.879385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3c3b72f0-0cfb-45b5-9022-fc6be4f1eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:01.029370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 876/1745] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:04:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:01.034391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8cfa7-91f2-4bb9-b461-aef0bac35280 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:01.036270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f2c8cfa7-91f2-4bb9-b461-aef0bac35280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:01.243227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8cfa7-91f2-4bb9-b461-aef0bac35280 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:01.257154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b72f0-0cfb-45b5-9022-fc6be4f1eea4 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:01.258985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3c3b72f0-0cfb-45b5-9022-fc6be4f1eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:01.259109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:01.260012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.260464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.260905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] PATH_INFO: `/v3/projects/2988157f4918469cb4069140adec060e` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.262761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2988157f4918469cb4069140adec060e)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:01.265552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:01.290248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b72f0-0cfb-45b5-9022-fc6be4f1eea4 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:01.299190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c2fdf-8a00-4a0d-8e77-1be2b4e20f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:01.300142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c2fdf-8a00-4a0d-8e77-1be2b4e20f4d service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.300587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c2fdf-8a00-4a0d-8e77-1be2b4e20f4d service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.300863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c2fdf-8a00-4a0d-8e77-1be2b4e20f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.311754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c2fdf-8a00-4a0d-8e77-1be2b4e20f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:01.313631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c2fdf-8a00-4a0d-8e77-1be2b4e20f4d service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:01.327692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 877/1746] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:01.455962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2988157f4918469cb4069140adec060e', 'request_id': 'req-8be90651-c000-43b2-9f95-7cb71ba5d727'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.524764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2988157f4918469cb4069140adec060e', 'request_id': 'req-8be90651-c000-43b2-9f95-7cb71ba5d727'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.542885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2988157f4918469cb4069140adec060e', 'request_id': 'req-8be90651-c000-43b2-9f95-7cb71ba5d727'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.571868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] The token cache is being invalidate because project 2988157f4918469cb4069140adec060e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:01.572172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.572851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8be90651-c000-43b2-9f95-7cb71ba5d727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.574865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 870/1747] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:01 2022] DELETE /identity/v3/projects/2988157f4918469cb4069140adec060e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:01.579978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723b0c7-f6e0-481e-855d-4f8626a1bce1 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.580357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723b0c7-f6e0-481e-855d-4f8626a1bce1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.580707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723b0c7-f6e0-481e-855d-4f8626a1bce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.600680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-6723b0c7-f6e0-481e-855d-4f8626a1bce1 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:01.601841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6723b0c7-f6e0-481e-855d-4f8626a1bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:01.671312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 878/1748] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:01.680302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7e58-2478-4d46-bddb-b3a0ebbe8e53 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.680609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7e58-2478-4d46-bddb-b3a0ebbe8e53 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.680868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c7e58-2478-4d46-bddb-b3a0ebbe8e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.703390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-188c7e58-2478-4d46-bddb-b3a0ebbe8e53 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:01.705005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-188c7e58-2478-4d46-bddb-b3a0ebbe8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:01.713657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 871/1749] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:01.724894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723b0c7-f6e0-481e-855d-4f8626a1bce1 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:01.735964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723b0c7-f6e0-481e-855d-4f8626a1bce1 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:01.740818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:01.741534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.741839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.742122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.743760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:01.744077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:01.746047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:01.759803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 879/1750] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:01.764935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7e58-2478-4d46-bddb-b3a0ebbe8e53 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:01.775518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c7e58-2478-4d46-bddb-b3a0ebbe8e53 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:01.780803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b98444-4594-47d3-9d56-cc727f647220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:01.781520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b98444-4594-47d3-9d56-cc727f647220 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.781826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b98444-4594-47d3-9d56-cc727f647220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.782083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b98444-4594-47d3-9d56-cc727f647220 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.782820 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b98444-4594-47d3-9d56-cc727f647220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:01.785157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b98444-4594-47d3-9d56-cc727f647220 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:01.992018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 872/1751] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:01 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:01.998617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:02.033534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd7ecc-7712-479d-927f-da4c21fb5f53 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:02.151354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0630-6f76-4369-8eaa-bcc9741a8f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:02.153658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0630-6f76-4369-8eaa-bcc9741a8f6f admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:02.154141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0630-6f76-4369-8eaa-bcc9741a8f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:02.154566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e0630-6f76-4369-8eaa-bcc9741a8f6f admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:02.155448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e0630-6f76-4369-8eaa-bcc9741a8f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:02.157646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e0630-6f76-4369-8eaa-bcc9741a8f6f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:02.322560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 880/1752] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:01 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:02.323843 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b98444-4594-47d3-9d56-cc727f647220 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:02.335506 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b98444-4594-47d3-9d56-cc727f647220 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:02.368368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3a63a-7e1a-4e3b-9cad-4f59879d2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:02.369729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3a63a-7e1a-4e3b-9cad-4f59879d2f65 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:02.370108 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3a63a-7e1a-4e3b-9cad-4f59879d2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:02.370547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3a63a-7e1a-4e3b-9cad-4f59879d2f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:02.371429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3a63a-7e1a-4e3b-9cad-4f59879d2f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:02.374133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3a63a-7e1a-4e3b-9cad-4f59879d2f65 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:02.389673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 873/1753] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:02.394283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0630-6f76-4369-8eaa-bcc9741a8f6f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:02.410585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e0630-6f76-4369-8eaa-bcc9741a8f6f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:02.416397 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a01f-f151-4197-9927-8fb39f8b3f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:02.417380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a01f-f151-4197-9927-8fb39f8b3f61 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:02.417842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a01f-f151-4197-9927-8fb39f8b3f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:02.418920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a01f-f151-4197-9927-8fb39f8b3f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:02.419926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a01f-f151-4197-9927-8fb39f8b3f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:02.421996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a01f-f151-4197-9927-8fb39f8b3f61 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:02.445720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 881/1754] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:02.448827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3a63a-7e1a-4e3b-9cad-4f59879d2f65 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:02.467217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3a63a-7e1a-4e3b-9cad-4f59879d2f65 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:02.480754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea9574-11be-4a94-8d0a-a5f8802d24ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:02.485623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea9574-11be-4a94-8d0a-a5f8802d24ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:02.485623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea9574-11be-4a94-8d0a-a5f8802d24ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:02.485623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea9574-11be-4a94-8d0a-a5f8802d24ca admin admin] PATH_INFO: `/v3/projects/73695e8125ca4028ab805752efb7034b/users/e4f2d90a65564698a3929dc9f3a5d01b/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:02.502635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea9574-11be-4a94-8d0a-a5f8802d24ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=73695e8125ca4028ab805752efb7034b, user_id=e4f2d90a65564698a3929dc9f3a5d01b, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:02.505746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea9574-11be-4a94-8d0a-a5f8802d24ca admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:02.610714 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 874/1755] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:02 2022] PUT /identity/v3/projects/73695e8125ca4028ab805752efb7034b/users/e4f2d90a65564698a3929dc9f3a5d01b/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:02.612939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f98e-03fd-4308-98b3-844ec248150d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:02.613256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f98e-03fd-4308-98b3-844ec248150d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:02.620144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028f98e-03fd-4308-98b3-844ec248150d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:02.675301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7028f98e-03fd-4308-98b3-844ec248150d None None] MFA Rules not processed for user `e4f2d90a65564698a3929dc9f3a5d01b`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:02.677386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7028f98e-03fd-4308-98b3-844ec248150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:02.769068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 882/1756] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:02.778746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea9574-11be-4a94-8d0a-a5f8802d24ca admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:02.864424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea9574-11be-4a94-8d0a-a5f8802d24ca admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:02.873788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a696299-bc8f-4e75-9dcb-70992e23fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:02.875228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a696299-bc8f-4e75-9dcb-70992e23fa84 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:02.875713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a696299-bc8f-4e75-9dcb-70992e23fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:02.877273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a696299-bc8f-4e75-9dcb-70992e23fa84 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:02.878933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a696299-bc8f-4e75-9dcb-70992e23fa84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:02.882906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a696299-bc8f-4e75-9dcb-70992e23fa84 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:03.095544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 875/1757] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:02 2022] POST /identity/v3/projects => generated 387 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:03.099682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f98e-03fd-4308-98b3-844ec248150d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:03.111966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028f98e-03fd-4308-98b3-844ec248150d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:03.218931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614eb3-f945-4268-bc00-0e03f6081346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:03.220399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614eb3-f945-4268-bc00-0e03f6081346 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:03.220789 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614eb3-f945-4268-bc00-0e03f6081346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:03.221138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614eb3-f945-4268-bc00-0e03f6081346 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:03.221907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614eb3-f945-4268-bc00-0e03f6081346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:03.224270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614eb3-f945-4268-bc00-0e03f6081346 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:03.358252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 883/1758] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:03 2022] POST /identity/v3/users => generated 300 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:03.361475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a696299-bc8f-4e75-9dcb-70992e23fa84 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:03.373671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a696299-bc8f-4e75-9dcb-70992e23fa84 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:03.380732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562ce7-491d-4eeb-96df-282489bdf948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:03.381850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562ce7-491d-4eeb-96df-282489bdf948 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:03.382583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562ce7-491d-4eeb-96df-282489bdf948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:03.383019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562ce7-491d-4eeb-96df-282489bdf948 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:03.383980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562ce7-491d-4eeb-96df-282489bdf948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:03.386798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562ce7-491d-4eeb-96df-282489bdf948 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:03.403965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 876/1759] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:03.408921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614eb3-f945-4268-bc00-0e03f6081346 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:03.425525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614eb3-f945-4268-bc00-0e03f6081346 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:03.434103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e03a7-0757-4547-8403-560f22627a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:03.436259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e03a7-0757-4547-8403-560f22627a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:03.437410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e03a7-0757-4547-8403-560f22627a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:03.437410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e03a7-0757-4547-8403-560f22627a9b admin admin] PATH_INFO: `/v3/projects/b32dc49251514ba8a6ad9eb737a74f53/users/4f14f5b2224347428e94ab549f33ec35/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:03.465977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e03a7-0757-4547-8403-560f22627a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32dc49251514ba8a6ad9eb737a74f53, user_id=4f14f5b2224347428e94ab549f33ec35, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:03.471966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e03a7-0757-4547-8403-560f22627a9b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:03.587233 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 884/1760] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:03 2022] PUT /identity/v3/projects/b32dc49251514ba8a6ad9eb737a74f53/users/4f14f5b2224347428e94ab549f33ec35/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:03.589437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562ce7-491d-4eeb-96df-282489bdf948 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:03.601159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562ce7-491d-4eeb-96df-282489bdf948 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:03.674073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb647e-bc00-4086-b198-d02417e14cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:03.674794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb647e-bc00-4086-b198-d02417e14cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:03.675204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb647e-bc00-4086-b198-d02417e14cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:03.675903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb647e-bc00-4086-b198-d02417e14cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:03.677206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb647e-bc00-4086-b198-d02417e14cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:03.681479 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb647e-bc00-4086-b198-d02417e14cf3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:03.692505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 877/1761] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:03.696773 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e03a7-0757-4547-8403-560f22627a9b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:03.708036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e03a7-0757-4547-8403-560f22627a9b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:03.713345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:03.714370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:03.714698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:03.714974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] PATH_INFO: `/v3/projects/b32dc49251514ba8a6ad9eb737a74f53/users/4f14f5b2224347428e94ab549f33ec35/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:03.726332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32dc49251514ba8a6ad9eb737a74f53, user_id=4f14f5b2224347428e94ab549f33ec35, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:03.726332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:03.741475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 885/1762] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:03 2022] PUT /identity/v3/projects/b32dc49251514ba8a6ad9eb737a74f53/users/4f14f5b2224347428e94ab549f33ec35/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:03.748968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de044db2-f676-45b4-92c0-6cfc0d9d2565 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:03.750417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de044db2-f676-45b4-92c0-6cfc0d9d2565 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:03.751194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de044db2-f676-45b4-92c0-6cfc0d9d2565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:03.789340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-de044db2-f676-45b4-92c0-6cfc0d9d2565 None None] MFA Rules not processed for user `4f14f5b2224347428e94ab549f33ec35`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:03.799070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-de044db2-f676-45b4-92c0-6cfc0d9d2565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:03.883949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 878/1763] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:03.896441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:03.898517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:03.970251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50beafb-973d-4956-a332-5abc41eec3e4 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:03.973972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1d69c-48a7-4dcb-95b0-f1ca139fc1c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:03.974631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d69c-48a7-4dcb-95b0-f1ca139fc1c4 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:03.974912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d69c-48a7-4dcb-95b0-f1ca139fc1c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:03.975187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d69c-48a7-4dcb-95b0-f1ca139fc1c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:03.988619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d69c-48a7-4dcb-95b0-f1ca139fc1c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:03.991406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d69c-48a7-4dcb-95b0-f1ca139fc1c4 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:04.009826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 886/1764] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:04.082408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de044db2-f676-45b4-92c0-6cfc0d9d2565 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:04.152505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de044db2-f676-45b4-92c0-6cfc0d9d2565 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:04.157721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:04.158610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:04.158894 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:04.159176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] PATH_INFO: `/v3/users/e4f2d90a65564698a3929dc9f3a5d01b` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:04.160437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f2d90a65564698a3929dc9f3a5d01b)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:04.162409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:04.437918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f2d90a65564698a3929dc9f3a5d01b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:04.467870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f2d90a65564698a3929dc9f3a5d01b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:04.467870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f2d90a65564698a3929dc9f3a5d01b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:04.467870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f2d90a65564698a3929dc9f3a5d01b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:04.603817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f2d90a65564698a3929dc9f3a5d01b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:04.629788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 879/1765] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:04 2022] DELETE /identity/v3/users/e4f2d90a65564698a3929dc9f3a5d01b => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:04.634059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27519-55a1-454e-b500-28a106479774 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:04.634941 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27519-55a1-454e-b500-28a106479774 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:04.634941 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e27519-55a1-454e-b500-28a106479774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:04.661436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d6e27519-55a1-454e-b500-28a106479774 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:04.662588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d6e27519-55a1-454e-b500-28a106479774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:04.728121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 887/1766] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:04.741754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:04.742025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e27519-55a1-454e-b500-28a106479774 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:04.743388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:04.750921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d6e27519-55a1-454e-b500-28a106479774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:04.816307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10223d-3f82-43cb-8da7-f7d9902a8925 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:04.821227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:04.821954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:04.823597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:04.824048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:04.839673 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e27519-55a1-454e-b500-28a106479774 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:04.840086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:04.842092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:04.844594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331aabd1-2072-4514-9253-4b2e21fc8c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:04.845300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aabd1-2072-4514-9253-4b2e21fc8c0c service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:04.848734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aabd1-2072-4514-9253-4b2e21fc8c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:04.848993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331aabd1-2072-4514-9253-4b2e21fc8c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:04.854467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 880/1767] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:04.871677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-331aabd1-2072-4514-9253-4b2e21fc8c0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:04.925668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aabd1-2072-4514-9253-4b2e21fc8c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:04.927030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331aabd1-2072-4514-9253-4b2e21fc8c0c service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:04.938793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 888/1768] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:06.818097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:06.821964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:06.847922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c98e4-6e02-44b8-8202-c9c5b3245c47 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:06.848396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c98e4-6e02-44b8-8202-c9c5b3245c47 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:06.848471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c98e4-6e02-44b8-8202-c9c5b3245c47 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:06.850144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 889/1769] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:04:06.866095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f195-406e-443f-868b-4aa7fb6fc884 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:06.866563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f195-406e-443f-868b-4aa7fb6fc884 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:06.867052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f195-406e-443f-868b-4aa7fb6fc884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:06.867932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07356a2-b7a5-485f-a6a6-ee4b47fb7d4c service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:06.881700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:06.887645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:06.894889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:06.894889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] PATH_INFO: `/v3/projects/73695e8125ca4028ab805752efb7034b` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:06.900767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73695e8125ca4028ab805752efb7034b)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:06.905428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:06.918361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9ec9f195-406e-443f-868b-4aa7fb6fc884 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:06.925750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9ec9f195-406e-443f-868b-4aa7fb6fc884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:07.018734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 890/1770] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:04:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 04 14:04:07.031088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f195-406e-443f-868b-4aa7fb6fc884 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:07.032462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9ec9f195-406e-443f-868b-4aa7fb6fc884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:07.047214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f195-406e-443f-868b-4aa7fb6fc884 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:07.057770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796e420-fd88-48c1-9aa8-aa39276c2c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:07.058654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796e420-fd88-48c1-9aa8-aa39276c2c8e service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:07.058969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796e420-fd88-48c1-9aa8-aa39276c2c8e service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:07.060752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796e420-fd88-48c1-9aa8-aa39276c2c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:07.079749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796e420-fd88-48c1-9aa8-aa39276c2c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:07.081529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796e420-fd88-48c1-9aa8-aa39276c2c8e service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:07.089229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73695e8125ca4028ab805752efb7034b', 'request_id': 'req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:07.094465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 891/1771] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:07.273131 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73695e8125ca4028ab805752efb7034b', 'request_id': 'req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:07.284451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73695e8125ca4028ab805752efb7034b', 'request_id': 'req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:07.297946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] The token cache is being invalidate because project 73695e8125ca4028ab805752efb7034b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:07.298540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:07.299535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:07.302649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 881/1772] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:06 2022] DELETE /identity/v3/projects/73695e8125ca4028ab805752efb7034b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:07.307008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796e420-fd88-48c1-9aa8-aa39276c2c8e service nova] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:07.319649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796e420-fd88-48c1-9aa8-aa39276c2c8e service nova] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:07.408121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:07.408447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:07.408740 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:07.409017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] PATH_INFO: `/v3/users/4f14f5b2224347428e94ab549f33ec35` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:07.410447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f14f5b2224347428e94ab549f33ec35)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:07.412610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:07.884003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f14f5b2224347428e94ab549f33ec35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:07.909969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f14f5b2224347428e94ab549f33ec35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:07.910705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f14f5b2224347428e94ab549f33ec35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:07.911328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f14f5b2224347428e94ab549f33ec35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:08.050022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f14f5b2224347428e94ab549f33ec35'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:08.080398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 892/1773] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:07 2022] DELETE /identity/v3/users/4f14f5b2224347428e94ab549f33ec35 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:08.979934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:08.982769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:08.997221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c59d7-ce61-41d4-9eeb-9b76d24472e5 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:09.198261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:09.201410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:09.217183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:09.226548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d2595-3007-4bc5-9101-7e872c5a63a1 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:09.227007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:09.227538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:09.228044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] PATH_INFO: `/v3/projects/b32dc49251514ba8a6ad9eb737a74f53` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:09.232243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32dc49251514ba8a6ad9eb737a74f53)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:09.237132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:09.251198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:09.252120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:09.252410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:09.252687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] PATH_INFO: `/v3/users/a5f6e43aba92497a9dc09da7daf06812` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:09.256636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f6e43aba92497a9dc09da7daf06812)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:09.258778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:09.461938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32dc49251514ba8a6ad9eb737a74f53', 'request_id': 'req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.626991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32dc49251514ba8a6ad9eb737a74f53', 'request_id': 'req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.633607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32dc49251514ba8a6ad9eb737a74f53', 'request_id': 'req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.659597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] The token cache is being invalidate because project b32dc49251514ba8a6ad9eb737a74f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:09.665182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.666078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8b29f1b2-78b7-4f4f-b405-fd504a6bb8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.668054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f6e43aba92497a9dc09da7daf06812'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.669592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 882/1774] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:08 2022] DELETE /identity/v3/projects/b32dc49251514ba8a6ad9eb737a74f53 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:09.676080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b06d-0a50-4e4c-be8f-2ffa363e4c7a None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:09.676449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b06d-0a50-4e4c-be8f-2ffa363e4c7a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:09.676801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b06d-0a50-4e4c-be8f-2ffa363e4c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:09.696899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f6e43aba92497a9dc09da7daf06812'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.702278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f6e43aba92497a9dc09da7daf06812'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.705406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f6e43aba92497a9dc09da7daf06812'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.721487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b117b06d-0a50-4e4c-be8f-2ffa363e4c7a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:09.722764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b117b06d-0a50-4e4c-be8f-2ffa363e4c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:09.822566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-adeab618-d58e-4391-a896-884bf43a627f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f6e43aba92497a9dc09da7daf06812'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:09.844822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 883/1775] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:09.854451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 893/1776] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:09 2022] DELETE /identity/v3/users/a5f6e43aba92497a9dc09da7daf06812 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:09.857973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5851-4567-49fd-98d0-a97576b075a0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:09.857973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5851-4567-49fd-98d0-a97576b075a0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:09.857973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5851-4567-49fd-98d0-a97576b075a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:09.858835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e99617-a785-48f8-b1fa-7b0c6a871bce None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:09.860156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e99617-a785-48f8-b1fa-7b0c6a871bce None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:09.860445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e99617-a785-48f8-b1fa-7b0c6a871bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:09.898363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-21ed5851-4567-49fd-98d0-a97576b075a0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:09.904123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-21ed5851-4567-49fd-98d0-a97576b075a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:09.904368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-29e99617-a785-48f8-b1fa-7b0c6a871bce None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:09.904368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-29e99617-a785-48f8-b1fa-7b0c6a871bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:10.028994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 884/1777] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:10.029631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed5851-4567-49fd-98d0-a97576b075a0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:10.055410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 894/1778] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:10.071845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed5851-4567-49fd-98d0-a97576b075a0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:10.076402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e99617-a785-48f8-b1fa-7b0c6a871bce None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:10.078034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-29e99617-a785-48f8-b1fa-7b0c6a871bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:10.078583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:10.079949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:10.080301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:10.080585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:10.081650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:10.082099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:10.085721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:10.153837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 885/1779] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:04:10.158048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:10.186454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160010-5d04-4aa3-925a-ca983935bcf0 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:10.200099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517933e7-f2b2-411d-a7ae-459d67c5abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:10.201602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e99617-a785-48f8-b1fa-7b0c6a871bce None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:10.205200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517933e7-f2b2-411d-a7ae-459d67c5abdc admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:10.207312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517933e7-f2b2-411d-a7ae-459d67c5abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:10.207802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517933e7-f2b2-411d-a7ae-459d67c5abdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:10.210729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd949e-392d-4e5a-a60b-fad8c1f46150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:10.211473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517933e7-f2b2-411d-a7ae-459d67c5abdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:10.211858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd949e-392d-4e5a-a60b-fad8c1f46150 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:10.217504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517933e7-f2b2-411d-a7ae-459d67c5abdc admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:10.221386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd949e-392d-4e5a-a60b-fad8c1f46150 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:10.221803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd949e-392d-4e5a-a60b-fad8c1f46150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:10.236421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd949e-392d-4e5a-a60b-fad8c1f46150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:10.237906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd949e-392d-4e5a-a60b-fad8c1f46150 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:10.255853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 895/1780] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:10.383041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 886/1781] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:10 2022] POST /identity/v3/projects => generated 401 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:10.388329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd949e-392d-4e5a-a60b-fad8c1f46150 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:10.400470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd949e-392d-4e5a-a60b-fad8c1f46150 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:10.473714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316299f0-2ea1-4f09-9b5f-47a44f2f1a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:10.474265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316299f0-2ea1-4f09-9b5f-47a44f2f1a7e admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:10.474577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316299f0-2ea1-4f09-9b5f-47a44f2f1a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:10.474929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316299f0-2ea1-4f09-9b5f-47a44f2f1a7e admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:10.475674 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316299f0-2ea1-4f09-9b5f-47a44f2f1a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:10.477877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316299f0-2ea1-4f09-9b5f-47a44f2f1a7e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:10.676601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517933e7-f2b2-411d-a7ae-459d67c5abdc admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:10.677027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 896/1782] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:10 2022] POST /identity/v3/users => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:10.695652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517933e7-f2b2-411d-a7ae-459d67c5abdc admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:10.702830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45875-df22-443b-b1c4-6b9b569c1a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:10.704474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45875-df22-443b-b1c4-6b9b569c1a6d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:10.704779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45875-df22-443b-b1c4-6b9b569c1a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:10.705406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45875-df22-443b-b1c4-6b9b569c1a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:10.707713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d45875-df22-443b-b1c4-6b9b569c1a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:10.710910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d45875-df22-443b-b1c4-6b9b569c1a6d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:10.754286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 887/1783] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:10.756341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316299f0-2ea1-4f09-9b5f-47a44f2f1a7e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:10.784614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316299f0-2ea1-4f09-9b5f-47a44f2f1a7e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:10.796163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610097d2-cb78-43dd-8739-860ea8cc4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:10.797553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610097d2-cb78-43dd-8739-860ea8cc4a81 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:10.797859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610097d2-cb78-43dd-8739-860ea8cc4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:10.799117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610097d2-cb78-43dd-8739-860ea8cc4a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:10.799117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610097d2-cb78-43dd-8739-860ea8cc4a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:10.801853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610097d2-cb78-43dd-8739-860ea8cc4a81 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:10.827943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 897/1784] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:10.828129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45875-df22-443b-b1c4-6b9b569c1a6d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:10.847314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45875-df22-443b-b1c4-6b9b569c1a6d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:10.858039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e806-5b45-49fd-a764-da9e91fc9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:10.860208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e806-5b45-49fd-a764-da9e91fc9264 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:10.860208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e806-5b45-49fd-a764-da9e91fc9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:10.860513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e806-5b45-49fd-a764-da9e91fc9264 admin admin] PATH_INFO: `/v3/projects/5e24550c13464acca90651f453c25492/users/f9d96b1c101a4e95824421fc8e9eca26/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:10.915276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e806-5b45-49fd-a764-da9e91fc9264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e24550c13464acca90651f453c25492, user_id=f9d96b1c101a4e95824421fc8e9eca26, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:10.924132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e806-5b45-49fd-a764-da9e91fc9264 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:11.083678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 888/1785] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:10 2022] PUT /identity/v3/projects/5e24550c13464acca90651f453c25492/users/f9d96b1c101a4e95824421fc8e9eca26/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:11.094784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd025f4-3dbe-44ff-8dd2-3c4798f80826 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:11.095401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd025f4-3dbe-44ff-8dd2-3c4798f80826 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:11.095591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd025f4-3dbe-44ff-8dd2-3c4798f80826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:11.152534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4cd025f4-3dbe-44ff-8dd2-3c4798f80826 None None] MFA Rules not processed for user `f9d96b1c101a4e95824421fc8e9eca26`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:11.156327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4cd025f4-3dbe-44ff-8dd2-3c4798f80826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:11.277721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 898/1786] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:11.282748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e806-5b45-49fd-a764-da9e91fc9264 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:11.379086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e806-5b45-49fd-a764-da9e91fc9264 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:11.385996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:11.386912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:11.388223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:11.388647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:11.392442 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:11.393342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:11.508280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 889/1787] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:11 2022] POST /identity/v3/projects => generated 401 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:11.509608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd025f4-3dbe-44ff-8dd2-3c4798f80826 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:11.524553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd025f4-3dbe-44ff-8dd2-3c4798f80826 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:11.562317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:11.565476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:11.623149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee3af0-6aba-43de-aeef-67a93e4eaa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:11.623865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3af0-6aba-43de-aeef-67a93e4eaa8c admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:11.624148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3af0-6aba-43de-aeef-67a93e4eaa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:11.624467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3af0-6aba-43de-aeef-67a93e4eaa8c admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:11.625752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee3af0-6aba-43de-aeef-67a93e4eaa8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:11.628560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee3af0-6aba-43de-aeef-67a93e4eaa8c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:11.671100 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fd6d7-d551-45b1-8acb-3db911457531 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:11.676147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:11.677109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:11.677480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:11.677828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] PATH_INFO: `/v3/projects/0e88b097e535429cb009924556cdb6f0` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:11.679145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e88b097e535429cb009924556cdb6f0)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:11.681194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:11.787697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 899/1788] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:11 2022] POST /identity/v3/users => generated 307 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:11.791710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee3af0-6aba-43de-aeef-67a93e4eaa8c admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:11.802118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee3af0-6aba-43de-aeef-67a93e4eaa8c admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:11.806927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b9241-0c6e-4cc2-b03d-6339d3e9b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:11.807597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b9241-0c6e-4cc2-b03d-6339d3e9b4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:11.807885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b9241-0c6e-4cc2-b03d-6339d3e9b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:11.808168 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b9241-0c6e-4cc2-b03d-6339d3e9b4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:11.809436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b9241-0c6e-4cc2-b03d-6339d3e9b4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:11.811083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b9241-0c6e-4cc2-b03d-6339d3e9b4c8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:11.821497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 900/1789] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:11.827014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b9241-0c6e-4cc2-b03d-6339d3e9b4c8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:11.840318 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b9241-0c6e-4cc2-b03d-6339d3e9b4c8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:11.848716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e88b097e535429cb009924556cdb6f0', 'request_id': 'req-8ef697fb-f86d-4e72-bb69-b1cef64a3263'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:11.917141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:11.918616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:11.919161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:11.919647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] PATH_INFO: `/v3/projects/5188fcf160164b488fff745174713f20/users/13cd9ab2e1af4c73b4eeb4559a32568c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:11.935936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5188fcf160164b488fff745174713f20, user_id=13cd9ab2e1af4c73b4eeb4559a32568c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:11.938714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:11.980002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e88b097e535429cb009924556cdb6f0', 'request_id': 'req-8ef697fb-f86d-4e72-bb69-b1cef64a3263'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:11.986849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e88b097e535429cb009924556cdb6f0', 'request_id': 'req-8ef697fb-f86d-4e72-bb69-b1cef64a3263'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:11.999208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] The token cache is being invalidate because project 0e88b097e535429cb009924556cdb6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:11.999493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:12.000415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8ef697fb-f86d-4e72-bb69-b1cef64a3263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:12.002277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 890/1790] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:11 2022] DELETE /identity/v3/projects/0e88b097e535429cb009924556cdb6f0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:12.006925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7aaa5-2ff2-479a-a6ee-c23aa414ff8f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.007214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7aaa5-2ff2-479a-a6ee-c23aa414ff8f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.007491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7aaa5-2ff2-479a-a6ee-c23aa414ff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.029322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-c9f7aaa5-2ff2-479a-a6ee-c23aa414ff8f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:12.030586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c9f7aaa5-2ff2-479a-a6ee-c23aa414ff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:12.039670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 891/1791] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:12.048582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa107-4bed-4d56-91a3-6276b744abf0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.048901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa107-4bed-4d56-91a3-6276b744abf0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.049183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaa107-4bed-4d56-91a3-6276b744abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.056719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 901/1792] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:11 2022] PUT /identity/v3/projects/5188fcf160164b488fff745174713f20/users/13cd9ab2e1af4c73b4eeb4559a32568c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:12.062253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.064018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:12.072899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6cdaa107-4bed-4d56-91a3-6276b744abf0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:12.074133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6cdaa107-4bed-4d56-91a3-6276b744abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:12.135735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49420c4-23e9-461a-82a4-fdaa0483fac3 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.142403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c74ba-d0c8-4953-ab19-cbfe2b81a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.143126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c74ba-d0c8-4953-ab19-cbfe2b81a260 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.143507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c74ba-d0c8-4953-ab19-cbfe2b81a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.143792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c74ba-d0c8-4953-ab19-cbfe2b81a260 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.144621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c74ba-d0c8-4953-ab19-cbfe2b81a260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.146352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c74ba-d0c8-4953-ab19-cbfe2b81a260 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:12.149110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 892/1793] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:12.157544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 902/1794] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:12.165417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaa107-4bed-4d56-91a3-6276b744abf0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.167648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c74ba-d0c8-4953-ab19-cbfe2b81a260 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.179321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c74ba-d0c8-4953-ab19-cbfe2b81a260 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.180113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaa107-4bed-4d56-91a3-6276b744abf0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.186668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62e7b6-3e95-4de1-affd-24d8b8e37093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.187254 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472f9a5-d920-4b97-b9df-75da85705dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.187369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62e7b6-3e95-4de1-affd-24d8b8e37093 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.187671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62e7b6-3e95-4de1-affd-24d8b8e37093 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.187983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62e7b6-3e95-4de1-affd-24d8b8e37093 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.188501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472f9a5-d920-4b97-b9df-75da85705dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.188911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472f9a5-d920-4b97-b9df-75da85705dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.189208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62e7b6-3e95-4de1-affd-24d8b8e37093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:12.189394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472f9a5-d920-4b97-b9df-75da85705dd8 admin admin] PATH_INFO: `/v3/projects/5188fcf160164b488fff745174713f20/users/13cd9ab2e1af4c73b4eeb4559a32568c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.189787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62e7b6-3e95-4de1-affd-24d8b8e37093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.192146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472f9a5-d920-4b97-b9df-75da85705dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5188fcf160164b488fff745174713f20, user_id=13cd9ab2e1af4c73b4eeb4559a32568c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.192350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62e7b6-3e95-4de1-affd-24d8b8e37093 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:12.195411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472f9a5-d920-4b97-b9df-75da85705dd8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:12.207277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 893/1795] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:12 2022] PUT /identity/v3/projects/5188fcf160164b488fff745174713f20/users/13cd9ab2e1af4c73b4eeb4559a32568c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:12.211176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 903/1796] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:04:12.219628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472f9a5-d920-4b97-b9df-75da85705dd8 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.226075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e2ae-19cd-4735-9d56-15a0103f3c5c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.226371 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e2ae-19cd-4735-9d56-15a0103f3c5c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.226842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4e2ae-19cd-4735-9d56-15a0103f3c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.258481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-aaf4e2ae-19cd-4735-9d56-15a0103f3c5c None None] MFA Rules not processed for user `13cd9ab2e1af4c73b4eeb4559a32568c`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:12.259366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-aaf4e2ae-19cd-4735-9d56-15a0103f3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:12.306498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472f9a5-d920-4b97-b9df-75da85705dd8 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.311842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f1a3-08f5-47e7-8d4e-5fe5bbb03e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.313308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f1a3-08f5-47e7-8d4e-5fe5bbb03e02 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.313805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f1a3-08f5-47e7-8d4e-5fe5bbb03e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.314070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f1a3-08f5-47e7-8d4e-5fe5bbb03e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.315274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f1a3-08f5-47e7-8d4e-5fe5bbb03e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.316691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f1a3-08f5-47e7-8d4e-5fe5bbb03e02 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:12.353469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 904/1797] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:12.364913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e2ae-19cd-4735-9d56-15a0103f3c5c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.366100 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-aaf4e2ae-19cd-4735-9d56-15a0103f3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:12.433800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4e2ae-19cd-4735-9d56-15a0103f3c5c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.437847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e92a-998a-45de-9de0-2bc97969d3aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.438497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e92a-998a-45de-9de0-2bc97969d3aa service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.438778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e92a-998a-45de-9de0-2bc97969d3aa service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.439055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e92a-998a-45de-9de0-2bc97969d3aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.449514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208e92a-998a-45de-9de0-2bc97969d3aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.451625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208e92a-998a-45de-9de0-2bc97969d3aa service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:12.464386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 905/1798] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:12.483922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 894/1799] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:12 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:12.489052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e92a-998a-45de-9de0-2bc97969d3aa service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.500548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e92a-998a-45de-9de0-2bc97969d3aa service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.560713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d01e-8bdf-4ff0-8d8c-33e82b0f20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.561416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d01e-8bdf-4ff0-8d8c-33e82b0f20bb admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.561701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d01e-8bdf-4ff0-8d8c-33e82b0f20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.561975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797d01e-8bdf-4ff0-8d8c-33e82b0f20bb admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.562679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797d01e-8bdf-4ff0-8d8c-33e82b0f20bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.564630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797d01e-8bdf-4ff0-8d8c-33e82b0f20bb admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:12.786374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 906/1800] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:12 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:12.791609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f1a3-08f5-47e7-8d4e-5fe5bbb03e02 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.807839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f1a3-08f5-47e7-8d4e-5fe5bbb03e02 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.815231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b563f-ed31-4027-b358-76ec221e023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.816129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b563f-ed31-4027-b358-76ec221e023e admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.816563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b563f-ed31-4027-b358-76ec221e023e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.816925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b563f-ed31-4027-b358-76ec221e023e admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.817792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b563f-ed31-4027-b358-76ec221e023e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.819620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b563f-ed31-4027-b358-76ec221e023e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:12.832146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 895/1801] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:12.836204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d01e-8bdf-4ff0-8d8c-33e82b0f20bb admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.852969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797d01e-8bdf-4ff0-8d8c-33e82b0f20bb admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.859158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f666-81d4-4176-a6f0-f8d17a1a59d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.861771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f666-81d4-4176-a6f0-f8d17a1a59d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.862074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f666-81d4-4176-a6f0-f8d17a1a59d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.862362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f666-81d4-4176-a6f0-f8d17a1a59d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.865759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96f666-81d4-4176-a6f0-f8d17a1a59d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.865759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96f666-81d4-4176-a6f0-f8d17a1a59d1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:12.893982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 907/1802] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:12.895548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b563f-ed31-4027-b358-76ec221e023e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:12.914301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b563f-ed31-4027-b358-76ec221e023e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:12.914301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:12.914960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:12.915318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:12.915660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] PATH_INFO: `/v3/projects/24136e3db6d44a988914782efee30134/users/29671104346248e3b62f52b497f23a1f/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:12.946768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24136e3db6d44a988914782efee30134, user_id=29671104346248e3b62f52b497f23a1f, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:12.949280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:13.070997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 896/1803] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:12 2022] PUT /identity/v3/projects/24136e3db6d44a988914782efee30134/users/29671104346248e3b62f52b497f23a1f/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:13.078611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e50af2-e154-4456-9643-80ccc8673f23 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:13.079115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e50af2-e154-4456-9643-80ccc8673f23 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:13.079394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e50af2-e154-4456-9643-80ccc8673f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:13.092268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:13.094231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:13.115503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-23e50af2-e154-4456-9643-80ccc8673f23 None None] MFA Rules not processed for user `29671104346248e3b62f52b497f23a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:13.116761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-23e50af2-e154-4456-9643-80ccc8673f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:13.177908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65e2c5-7fda-4599-aa66-d8d98d17dd7e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:13.181921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:13.182658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:13.183015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:13.183369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:13.185999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:13.190266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 908/1804] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:13.195200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e50af2-e154-4456-9643-80ccc8673f23 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:13.252622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:13.254112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:13.263745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 897/1805] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:13.270934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e50af2-e154-4456-9643-80ccc8673f23 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:13.276959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf2b4-a4c7-4d92-97eb-15dba608091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:13.278236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf2b4-a4c7-4d92-97eb-15dba608091b admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:13.278525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf2b4-a4c7-4d92-97eb-15dba608091b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:13.278813 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf2b4-a4c7-4d92-97eb-15dba608091b admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:13.280089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cf2b4-a4c7-4d92-97eb-15dba608091b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:13.281601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cf2b4-a4c7-4d92-97eb-15dba608091b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:13.445054 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:13.446732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:13.463480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b543-07ce-4d44-abe1-2404c7c2933c service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:13.469069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:13.470080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:13.470500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:13.470667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] PATH_INFO: `/v3/users/f0ddf5a4a37d41be8ce9516f8504fd7c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:13.471952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ddf5a4a37d41be8ce9516f8504fd7c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:13.474025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:13.501708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 909/1806] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:13 2022] POST /identity/v3/projects => generated 387 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:13.505446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf2b4-a4c7-4d92-97eb-15dba608091b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:13.577049 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf2b4-a4c7-4d92-97eb-15dba608091b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:13.581822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d259d-1609-4a4b-9362-557b58d7cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:13.582503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d259d-1609-4a4b-9362-557b58d7cc8e admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:13.582778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d259d-1609-4a4b-9362-557b58d7cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:13.583113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d259d-1609-4a4b-9362-557b58d7cc8e admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:13.583735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d259d-1609-4a4b-9362-557b58d7cc8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:13.585949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d259d-1609-4a4b-9362-557b58d7cc8e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:13.726701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 910/1807] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:13 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:13.730609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d259d-1609-4a4b-9362-557b58d7cc8e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:13.732336 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ddf5a4a37d41be8ce9516f8504fd7c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:13.741275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d259d-1609-4a4b-9362-557b58d7cc8e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:13.746726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ddf5a4a37d41be8ce9516f8504fd7c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:13.747787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ddf5a4a37d41be8ce9516f8504fd7c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:13.748730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ddf5a4a37d41be8ce9516f8504fd7c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:13.751941 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:13.752720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:13.753054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:13.753436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:13.754251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:13.755911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:13.768674 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 911/1808] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:13.773090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:13.775085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:13.790069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fe3cc-3dfc-4c49-b5d2-a7bb1cc46d28 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:13.796471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb6acd-c7f6-4807-9332-1c2425e8d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:13.797450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6acd-c7f6-4807-9332-1c2425e8d2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:13.797765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6acd-c7f6-4807-9332-1c2425e8d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:13.798040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6acd-c7f6-4807-9332-1c2425e8d2cf admin admin] PATH_INFO: `/v3/projects/f51edfa3a58c4e41a3dc2033c9938a66/users/43486cd1a4e847d2bf4aafda565f495a/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:13.814322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb6acd-c7f6-4807-9332-1c2425e8d2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51edfa3a58c4e41a3dc2033c9938a66, user_id=43486cd1a4e847d2bf4aafda565f495a, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:13.817260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb6acd-c7f6-4807-9332-1c2425e8d2cf admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:13.861021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-63f899c4-fba3-4845-9c0a-e6cbcfb44d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ddf5a4a37d41be8ce9516f8504fd7c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:13.874750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 898/1809] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:13 2022] DELETE /identity/v3/users/f0ddf5a4a37d41be8ce9516f8504fd7c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:13.888248 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140388b-c433-4339-9a71-81a3cb35754f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:13.888542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140388b-c433-4339-9a71-81a3cb35754f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:13.888822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140388b-c433-4339-9a71-81a3cb35754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:13.908424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0140388b-c433-4339-9a71-81a3cb35754f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:13.909694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0140388b-c433-4339-9a71-81a3cb35754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:13.938462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 912/1810] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:13 2022] PUT /identity/v3/projects/f51edfa3a58c4e41a3dc2033c9938a66/users/43486cd1a4e847d2bf4aafda565f495a/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:13.943052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb6acd-c7f6-4807-9332-1c2425e8d2cf admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:13.981211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 899/1811] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:14.000044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140388b-c433-4339-9a71-81a3cb35754f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:14.003926 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0140388b-c433-4339-9a71-81a3cb35754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:14.035629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb6acd-c7f6-4807-9332-1c2425e8d2cf admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:14.043126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b85b0-b52d-4f42-b374-3cdcf8342a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:14.044134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b85b0-b52d-4f42-b374-3cdcf8342a2e admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:14.044494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b85b0-b52d-4f42-b374-3cdcf8342a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:14.044927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b85b0-b52d-4f42-b374-3cdcf8342a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:14.045803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b85b0-b52d-4f42-b374-3cdcf8342a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:14.047521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b85b0-b52d-4f42-b374-3cdcf8342a2e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:14.060478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 913/1812] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:14.065803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b85b0-b52d-4f42-b374-3cdcf8342a2e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:14.078331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b85b0-b52d-4f42-b374-3cdcf8342a2e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:14.084656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cfde5-5c7b-4326-9d58-ac693df05b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:14.085792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfde5-5c7b-4326-9d58-ac693df05b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:14.086333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfde5-5c7b-4326-9d58-ac693df05b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:14.086612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfde5-5c7b-4326-9d58-ac693df05b2f admin admin] PATH_INFO: `/v3/projects/f51edfa3a58c4e41a3dc2033c9938a66/users/43486cd1a4e847d2bf4aafda565f495a/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:14.088901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cfde5-5c7b-4326-9d58-ac693df05b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51edfa3a58c4e41a3dc2033c9938a66, user_id=43486cd1a4e847d2bf4aafda565f495a, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:14.091799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cfde5-5c7b-4326-9d58-ac693df05b2f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:14.097148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140388b-c433-4339-9a71-81a3cb35754f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:14.104526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 914/1813] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:14 2022] PUT /identity/v3/projects/f51edfa3a58c4e41a3dc2033c9938a66/users/43486cd1a4e847d2bf4aafda565f495a/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:14.115368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f732f-023a-41d5-bd9e-f1f608fe3a5e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:14.115580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f732f-023a-41d5-bd9e-f1f608fe3a5e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:14.115846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f732f-023a-41d5-bd9e-f1f608fe3a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:14.168044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-bd7f732f-023a-41d5-bd9e-f1f608fe3a5e None None] MFA Rules not processed for user `43486cd1a4e847d2bf4aafda565f495a`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:14.169581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-bd7f732f-023a-41d5-bd9e-f1f608fe3a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:14.185910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1d213-c698-4871-aa1c-897401a8bdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:14.187770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1d213-c698-4871-aa1c-897401a8bdee service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:14.194196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1d213-c698-4871-aa1c-897401a8bdee service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:14.194196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1d213-c698-4871-aa1c-897401a8bdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:14.280043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 915/1814] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:14.327015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f732f-023a-41d5-bd9e-f1f608fe3a5e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:14.328764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-bd7f732f-023a-41d5-bd9e-f1f608fe3a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:14.364863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1d213-c698-4871-aa1c-897401a8bdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:14.366849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1d213-c698-4871-aa1c-897401a8bdee service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:14.389140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 900/1815] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:14.432997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f732f-023a-41d5-bd9e-f1f608fe3a5e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:14.440527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:14.441843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:14.442387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:14.442925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:14.457949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:14.459771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:14.474793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 916/1816] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:14.652081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1d213-c698-4871-aa1c-897401a8bdee service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:14.664274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1d213-c698-4871-aa1c-897401a8bdee service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:14.670218 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:14.671104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:14.671380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:14.671650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] PATH_INFO: `/v3/users/29671104346248e3b62f52b497f23a1f` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:14.673452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29671104346248e3b62f52b497f23a1f)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:14.675047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:15.035847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29671104346248e3b62f52b497f23a1f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.050630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29671104346248e3b62f52b497f23a1f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.051483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29671104346248e3b62f52b497f23a1f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.052046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29671104346248e3b62f52b497f23a1f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.115003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:15.116529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:15.129792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1987b19-e439-4e5c-917a-1c494ca1e91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29671104346248e3b62f52b497f23a1f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.131264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcea7fb-58af-48a1-b5b7-091976c1437b service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:15.142459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:15.143513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:15.143948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:15.144251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] PATH_INFO: `/v3/projects/5c5268bd7ab54f548c2d789f69092e70` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:15.145588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5268bd7ab54f548c2d789f69092e70)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:15.145693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 901/1817] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:14 2022] DELETE /identity/v3/users/29671104346248e3b62f52b497f23a1f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:15.148573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:15.151573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc426269-447f-4e41-9641-e4717062d98e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:15.151868 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc426269-447f-4e41-9641-e4717062d98e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:15.152142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc426269-447f-4e41-9641-e4717062d98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:15.171488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-cc426269-447f-4e41-9641-e4717062d98e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:15.172834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-cc426269-447f-4e41-9641-e4717062d98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:15.251265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 902/1818] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:15.259616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc426269-447f-4e41-9641-e4717062d98e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:15.261101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-cc426269-447f-4e41-9641-e4717062d98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:15.308449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5268bd7ab54f548c2d789f69092e70', 'request_id': 'req-ae3fc727-662b-4677-864e-e86ff4200e05'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.334482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc426269-447f-4e41-9641-e4717062d98e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:15.403199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:15.403897 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:15.404183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:15.404461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:15.427071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5268bd7ab54f548c2d789f69092e70', 'request_id': 'req-ae3fc727-662b-4677-864e-e86ff4200e05'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.435625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5268bd7ab54f548c2d789f69092e70', 'request_id': 'req-ae3fc727-662b-4677-864e-e86ff4200e05'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.453054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] The token cache is being invalidate because project 5c5268bd7ab54f548c2d789f69092e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:15.453277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.453877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.458533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 917/1819] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:15 2022] DELETE /identity/v3/projects/5c5268bd7ab54f548c2d789f69092e70 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:15.467665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:15.467665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:15.483824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:15.485582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:15.498070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 903/1820] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:15.544286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc727-662b-4677-864e-e86ff4200e05 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:15.550556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:15.552683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:15.552683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:15.552683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] PATH_INFO: `/v3/users/10e3972e46ba450182da0834989c0115` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:15.554067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e3972e46ba450182da0834989c0115)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:15.556288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:15.830283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e3972e46ba450182da0834989c0115'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.844988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e3972e46ba450182da0834989c0115'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.846102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e3972e46ba450182da0834989c0115'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.846723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e3972e46ba450182da0834989c0115'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.952697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e3972e46ba450182da0834989c0115'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:15.966472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 918/1821] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:15 2022] DELETE /identity/v3/users/10e3972e46ba450182da0834989c0115 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:15.994863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:15.997430 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:16.012905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2dce2-bc68-4ac7-bd4d-5d0e8a26c3aa service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:16.081840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:16.082816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:16.083103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:16.083378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] PATH_INFO: `/v3/projects/24136e3db6d44a988914782efee30134` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:16.084645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=24136e3db6d44a988914782efee30134)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:16.086613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:16.214137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24136e3db6d44a988914782efee30134', 'request_id': 'req-3d74c6de-3aa7-47b9-91bf-1174c83edbea'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:16.323695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24136e3db6d44a988914782efee30134', 'request_id': 'req-3d74c6de-3aa7-47b9-91bf-1174c83edbea'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:16.334172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24136e3db6d44a988914782efee30134', 'request_id': 'req-3d74c6de-3aa7-47b9-91bf-1174c83edbea'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:16.347072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] The token cache is being invalidate because project 24136e3db6d44a988914782efee30134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:16.347360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:16.348037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:16.349705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 904/1822] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:15 2022] DELETE /identity/v3/projects/24136e3db6d44a988914782efee30134 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:16.353924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:16.355595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:16.373114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb7a49-ec33-4345-8244-5a4728275bdd admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:16.448509 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:16.483814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:16.483814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:16.483814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] PATH_INFO: `/v3/users/43486cd1a4e847d2bf4aafda565f495a` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:16.483814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43486cd1a4e847d2bf4aafda565f495a)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:16.483814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:16.664796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:16.673666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:16.696833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74c6de-3aa7-47b9-91bf-1174c83edbea admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:16.703171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:16.718645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:16.718645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:16.718645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] PATH_INFO: `/v3/projects/71cb39671bfc4c4484898a7e82df3213` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:16.718645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71cb39671bfc4c4484898a7e82df3213)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:16.718645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:17.047368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43486cd1a4e847d2bf4aafda565f495a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.049733 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71cb39671bfc4c4484898a7e82df3213', 'request_id': 'req-8a894e43-e680-4a61-b4ce-bfa35f2191e7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.061792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43486cd1a4e847d2bf4aafda565f495a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.062549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43486cd1a4e847d2bf4aafda565f495a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.063161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43486cd1a4e847d2bf4aafda565f495a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.232828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71cb39671bfc4c4484898a7e82df3213', 'request_id': 'req-8a894e43-e680-4a61-b4ce-bfa35f2191e7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.239087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71cb39671bfc4c4484898a7e82df3213', 'request_id': 'req-8a894e43-e680-4a61-b4ce-bfa35f2191e7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.253024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] The token cache is being invalidate because project 71cb39671bfc4c4484898a7e82df3213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:17.253343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.254059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.255837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 905/1823] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:16 2022] DELETE /identity/v3/projects/71cb39671bfc4c4484898a7e82df3213 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:17.269143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:17.270784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:17.358045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894e43-e680-4a61-b4ce-bfa35f2191e7 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:17.362799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:17.363703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:17.363989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:17.364270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] PATH_INFO: `/v3/users/1e23875ffb144ad2b9558d75d42f9a94` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:17.365539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e23875ffb144ad2b9558d75d42f9a94)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:17.367536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:17.523537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43486cd1a4e847d2bf4aafda565f495a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.541454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 919/1824] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:16 2022] DELETE /identity/v3/users/43486cd1a4e847d2bf4aafda565f495a => generated 0 bytes in 1188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:17.788918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e23875ffb144ad2b9558d75d42f9a94'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.809781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e23875ffb144ad2b9558d75d42f9a94'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.811723 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e23875ffb144ad2b9558d75d42f9a94'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.814431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e23875ffb144ad2b9558d75d42f9a94'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.896573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e23875ffb144ad2b9558d75d42f9a94'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:17.913750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 906/1825] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:17 2022] DELETE /identity/v3/users/1e23875ffb144ad2b9558d75d42f9a94 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:18.215503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:18.217212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:18.318149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dde45-e323-4534-9f51-0742bb4ccac2 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:18.378807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:18.379683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:18.379967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:18.380238 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] PATH_INFO: `/v3/projects/f51edfa3a58c4e41a3dc2033c9938a66` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:18.381541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51edfa3a58c4e41a3dc2033c9938a66)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:18.383502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:18.413690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:18.415489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:18.442869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4476f-13fa-4175-95bf-cda1a08cb571 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:18.447780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:18.448677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:18.448994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:18.449301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] PATH_INFO: `/v3/projects/de2792c6ae8b4479b99da841718d1195` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:18.451489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2792c6ae8b4479b99da841718d1195)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:18.453495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:18.627602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51edfa3a58c4e41a3dc2033c9938a66', 'request_id': 'req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.669191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2792c6ae8b4479b99da841718d1195', 'request_id': 'req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.735128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51edfa3a58c4e41a3dc2033c9938a66', 'request_id': 'req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.742334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51edfa3a58c4e41a3dc2033c9938a66', 'request_id': 'req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.761405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] The token cache is being invalidate because project f51edfa3a58c4e41a3dc2033c9938a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:18.762045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.763659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-02ca2e93-a6fa-40c7-a2a8-5f37c697f279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.777428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 920/1826] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:18 2022] DELETE /identity/v3/projects/f51edfa3a58c4e41a3dc2033c9938a66 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:18.782821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd96e3-753a-43f0-81fc-b55e2b83d6a3 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:18.783118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd96e3-753a-43f0-81fc-b55e2b83d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:18.783399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd96e3-753a-43f0-81fc-b55e2b83d6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:18.798676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2792c6ae8b4479b99da841718d1195', 'request_id': 'req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.805647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-fdcd96e3-753a-43f0-81fc-b55e2b83d6a3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:18.806519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2792c6ae8b4479b99da841718d1195', 'request_id': 'req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.811898 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-fdcd96e3-753a-43f0-81fc-b55e2b83d6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:18.822789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] The token cache is being invalidate because project de2792c6ae8b4479b99da841718d1195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:18.823075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.823756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-61117e9a-f088-4bfe-b7d6-e18eeb7fbbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:18.830703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 907/1827] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:18 2022] DELETE /identity/v3/projects/de2792c6ae8b4479b99da841718d1195 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:18.833168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea1ed8-f9ee-4e54-a042-eb313c015f13 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:18.833498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea1ed8-f9ee-4e54-a042-eb313c015f13 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:18.833827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea1ed8-f9ee-4e54-a042-eb313c015f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:18.855553 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0aea1ed8-f9ee-4e54-a042-eb313c015f13 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:18.857047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0aea1ed8-f9ee-4e54-a042-eb313c015f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:18.880605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 921/1828] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:18.889922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849506f9-2d70-42da-988e-49f631fdc8fb None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:18.890206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849506f9-2d70-42da-988e-49f631fdc8fb None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:18.890588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849506f9-2d70-42da-988e-49f631fdc8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:18.912180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-849506f9-2d70-42da-988e-49f631fdc8fb None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:18.914270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-849506f9-2d70-42da-988e-49f631fdc8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:18.937075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 922/1829] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:18.941577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849506f9-2d70-42da-988e-49f631fdc8fb None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:18.953121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 908/1830] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:18.953764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849506f9-2d70-42da-988e-49f631fdc8fb None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:18.955082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5cd1-2616-4f18-9241-91123de76c52 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:18.955579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5cd1-2616-4f18-9241-91123de76c52 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:18.956031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5cd1-2616-4f18-9241-91123de76c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:18.960075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:18.960924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:18.961291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:18.961621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:18.965092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:18.965092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:18.965092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:18.987132 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-690a5cd1-2616-4f18-9241-91123de76c52 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:18.989761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-690a5cd1-2616-4f18-9241-91123de76c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:18.992220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 923/1831] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:19.008213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 909/1832] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:19.009504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.015573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5cd1-2616-4f18-9241-91123de76c52 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.034325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5cd1-2616-4f18-9241-91123de76c52 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.034421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1efd4-c9da-49d3-9403-10201117e300 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.056264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2a07f-ef9e-41a5-a11c-1361c464a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.057404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2a07f-ef9e-41a5-a11c-1361c464a024 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.057831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2a07f-ef9e-41a5-a11c-1361c464a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.058323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2a07f-ef9e-41a5-a11c-1361c464a024 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.061072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2a07f-ef9e-41a5-a11c-1361c464a024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.064214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.064913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.065197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.065498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.066243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:19.066748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.068373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.082517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2a07f-ef9e-41a5-a11c-1361c464a024 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.088466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 910/1833] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:19.093349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.116013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a586348-a4fb-4391-9414-587497a6f2e2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.124521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481333-4de0-4169-8cb5-4c6b15852ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.125831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481333-4de0-4169-8cb5-4c6b15852ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.129968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481333-4de0-4169-8cb5-4c6b15852ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.129968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481333-4de0-4169-8cb5-4c6b15852ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.129968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36481333-4de0-4169-8cb5-4c6b15852ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.129968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36481333-4de0-4169-8cb5-4c6b15852ad6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.230049 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 924/1834] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:19 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:19.231684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2a07f-ef9e-41a5-a11c-1361c464a024 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.298489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 911/1835] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:19 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:19.300863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481333-4de0-4169-8cb5-4c6b15852ad6 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.356671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2a07f-ef9e-41a5-a11c-1361c464a024 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.397085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481333-4de0-4169-8cb5-4c6b15852ad6 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.403244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40266e2-a67e-4b67-a87d-48fcf9c29c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.404209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40266e2-a67e-4b67-a87d-48fcf9c29c4f admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.404498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40266e2-a67e-4b67-a87d-48fcf9c29c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.405004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40266e2-a67e-4b67-a87d-48fcf9c29c4f admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.405803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40266e2-a67e-4b67-a87d-48fcf9c29c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.407987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40266e2-a67e-4b67-a87d-48fcf9c29c4f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.458293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f63dd-253e-4e7c-998c-25cc60dff079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.459482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f63dd-253e-4e7c-998c-25cc60dff079 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.459974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f63dd-253e-4e7c-998c-25cc60dff079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.462220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f63dd-253e-4e7c-998c-25cc60dff079 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.462220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f63dd-253e-4e7c-998c-25cc60dff079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.464605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f63dd-253e-4e7c-998c-25cc60dff079 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.581453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 925/1836] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:19 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:19.581648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 912/1837] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:19 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:19.585325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40266e2-a67e-4b67-a87d-48fcf9c29c4f admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.585454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f63dd-253e-4e7c-998c-25cc60dff079 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.604922 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40266e2-a67e-4b67-a87d-48fcf9c29c4f admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.612051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552730e5-4463-43a3-b8ba-eca7bfe8ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.612918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f63dd-253e-4e7c-998c-25cc60dff079 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.613276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552730e5-4463-43a3-b8ba-eca7bfe8ad5f admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.613743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552730e5-4463-43a3-b8ba-eca7bfe8ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.614223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552730e5-4463-43a3-b8ba-eca7bfe8ad5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.615216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552730e5-4463-43a3-b8ba-eca7bfe8ad5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.617050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552730e5-4463-43a3-b8ba-eca7bfe8ad5f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.628583 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795bf14-319e-4155-809c-32b8e8fce269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.629802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 913/1838] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:19.633855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552730e5-4463-43a3-b8ba-eca7bfe8ad5f admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.634040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795bf14-319e-4155-809c-32b8e8fce269 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.634562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795bf14-319e-4155-809c-32b8e8fce269 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.635014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795bf14-319e-4155-809c-32b8e8fce269 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.636162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795bf14-319e-4155-809c-32b8e8fce269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.639007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795bf14-319e-4155-809c-32b8e8fce269 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.650116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552730e5-4463-43a3-b8ba-eca7bfe8ad5f admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.651406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 926/1839] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:19.656159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795bf14-319e-4155-809c-32b8e8fce269 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.660530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33575d-cd79-4426-829a-e85f6281a4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.661226 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33575d-cd79-4426-829a-e85f6281a4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.661544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33575d-cd79-4426-829a-e85f6281a4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.661823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33575d-cd79-4426-829a-e85f6281a4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.667338 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795bf14-319e-4155-809c-32b8e8fce269 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.668020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33575d-cd79-4426-829a-e85f6281a4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.670395 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33575d-cd79-4426-829a-e85f6281a4b2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.673956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9161398-3e1d-49b2-8b4f-f4e9839e6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.674705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9161398-3e1d-49b2-8b4f-f4e9839e6702 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.675751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9161398-3e1d-49b2-8b4f-f4e9839e6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.675751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9161398-3e1d-49b2-8b4f-f4e9839e6702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.676206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9161398-3e1d-49b2-8b4f-f4e9839e6702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.678033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9161398-3e1d-49b2-8b4f-f4e9839e6702 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.683749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 914/1840] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:19.689580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33575d-cd79-4426-829a-e85f6281a4b2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.697801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 927/1841] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:19.711496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9161398-3e1d-49b2-8b4f-f4e9839e6702 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:19.712882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33575d-cd79-4426-829a-e85f6281a4b2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.720890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a644ae3-92cd-447b-8060-751218ce2848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.721894 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a644ae3-92cd-447b-8060-751218ce2848 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.722176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a644ae3-92cd-447b-8060-751218ce2848 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.722447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a644ae3-92cd-447b-8060-751218ce2848 admin admin] PATH_INFO: `/v3/projects/5ab48450db584c37b392a7db81a5d0e4/users/8f9b4e698fac4734b65709c355a53f9a/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.725978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9161398-3e1d-49b2-8b4f-f4e9839e6702 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:19.733990 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c69dd3-e52a-4084-8b71-d51972590454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:19.735648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c69dd3-e52a-4084-8b71-d51972590454 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.736180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c69dd3-e52a-4084-8b71-d51972590454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.736855 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c69dd3-e52a-4084-8b71-d51972590454 admin admin] PATH_INFO: `/v3/projects/136b72dc56bf4d3e9f3b5242cee8f6c5/users/70eb175678a04c519c155606a52793fc/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.743959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a644ae3-92cd-447b-8060-751218ce2848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab48450db584c37b392a7db81a5d0e4, user_id=8f9b4e698fac4734b65709c355a53f9a, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.747260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a644ae3-92cd-447b-8060-751218ce2848 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.760302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c69dd3-e52a-4084-8b71-d51972590454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136b72dc56bf4d3e9f3b5242cee8f6c5, user_id=70eb175678a04c519c155606a52793fc, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:19.764920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c69dd3-e52a-4084-8b71-d51972590454 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:19.896340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 928/1842] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:19 2022] PUT /identity/v3/projects/136b72dc56bf4d3e9f3b5242cee8f6c5/users/70eb175678a04c519c155606a52793fc/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:19.900351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 915/1843] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:19 2022] PUT /identity/v3/projects/5ab48450db584c37b392a7db81a5d0e4/users/8f9b4e698fac4734b65709c355a53f9a/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:19.914103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52c1e5-fa53-4591-b442-109a097a089e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.914394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52c1e5-fa53-4591-b442-109a097a089e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.914680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52c1e5-fa53-4591-b442-109a097a089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.916287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e66e84-e2f6-40df-b474-103ade1191ce None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:19.916577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e66e84-e2f6-40df-b474-103ade1191ce None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:19.916849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e66e84-e2f6-40df-b474-103ade1191ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:19.946248 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-62e66e84-e2f6-40df-b474-103ade1191ce None None] MFA Rules not processed for user `70eb175678a04c519c155606a52793fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:19.947167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-62e66e84-e2f6-40df-b474-103ade1191ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:19.948996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8b52c1e5-fa53-4591-b442-109a097a089e None None] MFA Rules not processed for user `8f9b4e698fac4734b65709c355a53f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:19.950736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8b52c1e5-fa53-4591-b442-109a097a089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:20.036957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 929/1844] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:20.042209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52c1e5-fa53-4591-b442-109a097a089e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.043086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 916/1845] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:20.051076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e66e84-e2f6-40df-b474-103ade1191ce None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.154336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52c1e5-fa53-4591-b442-109a097a089e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.162696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e66e84-e2f6-40df-b474-103ade1191ce None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.163057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07abfb-ed7d-49e6-a8ed-14482905a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.164718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07abfb-ed7d-49e6-a8ed-14482905a450 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.164718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07abfb-ed7d-49e6-a8ed-14482905a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.164718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07abfb-ed7d-49e6-a8ed-14482905a450 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.166213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07abfb-ed7d-49e6-a8ed-14482905a450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.167908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9572c-7b5b-40c7-a636-b021925c1c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.168859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9572c-7b5b-40c7-a636-b021925c1c7c admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.169345 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9572c-7b5b-40c7-a636-b021925c1c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.169986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9572c-7b5b-40c7-a636-b021925c1c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.170633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9572c-7b5b-40c7-a636-b021925c1c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.172567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9572c-7b5b-40c7-a636-b021925c1c7c admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.174394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07abfb-ed7d-49e6-a8ed-14482905a450 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.274308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 917/1846] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:20 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:20.278477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9572c-7b5b-40c7-a636-b021925c1c7c admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.318277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 930/1847] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:20 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:20.328073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07abfb-ed7d-49e6-a8ed-14482905a450 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.353014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9572c-7b5b-40c7-a636-b021925c1c7c admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.422932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305342-34b4-4dd1-9b10-101435e565b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.423138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07abfb-ed7d-49e6-a8ed-14482905a450 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.423357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305342-34b4-4dd1-9b10-101435e565b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.423826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305342-34b4-4dd1-9b10-101435e565b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.424148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305342-34b4-4dd1-9b10-101435e565b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.424826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71305342-34b4-4dd1-9b10-101435e565b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.426809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71305342-34b4-4dd1-9b10-101435e565b7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.428452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a34c-f8a8-443c-bb76-129afb5d974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.429202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a34c-f8a8-443c-bb76-129afb5d974a admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.429658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a34c-f8a8-443c-bb76-129afb5d974a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.429994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a34c-f8a8-443c-bb76-129afb5d974a admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.431008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a34c-f8a8-443c-bb76-129afb5d974a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.435710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a34c-f8a8-443c-bb76-129afb5d974a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.582147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 918/1848] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:20 2022] POST /identity/v3/users => generated 299 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:20.587246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305342-34b4-4dd1-9b10-101435e565b7 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.599903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71305342-34b4-4dd1-9b10-101435e565b7 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.607950 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa792-1166-4ad0-8645-e2f7fa89bb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.608634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa792-1166-4ad0-8645-e2f7fa89bb65 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.609025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa792-1166-4ad0-8645-e2f7fa89bb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.609204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa792-1166-4ad0-8645-e2f7fa89bb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.609991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa792-1166-4ad0-8645-e2f7fa89bb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.611630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa792-1166-4ad0-8645-e2f7fa89bb65 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.622937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 919/1849] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:20.633931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa792-1166-4ad0-8645-e2f7fa89bb65 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.643717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa792-1166-4ad0-8645-e2f7fa89bb65 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.645902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 931/1850] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:20 2022] POST /identity/v3/users => generated 296 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:20.648589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e0f5-d919-4b90-a978-01f1e4f328a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.649621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e0f5-d919-4b90-a978-01f1e4f328a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.649914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e0f5-d919-4b90-a978-01f1e4f328a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.662501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e0f5-d919-4b90-a978-01f1e4f328a6 admin admin] PATH_INFO: `/v3/projects/cd7110da00a74c2dbea398f87efc6369/users/e1f3f8fa735747bd96d03bf3e300a56b/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.664457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a34c-f8a8-443c-bb76-129afb5d974a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.670291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e0f5-d919-4b90-a978-01f1e4f328a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7110da00a74c2dbea398f87efc6369, user_id=e1f3f8fa735747bd96d03bf3e300a56b, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.673090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e0f5-d919-4b90-a978-01f1e4f328a6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.680437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a34c-f8a8-443c-bb76-129afb5d974a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.686333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db43ee5-9434-4e49-a7a1-f297722f5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.687005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43ee5-9434-4e49-a7a1-f297722f5e42 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.687289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43ee5-9434-4e49-a7a1-f297722f5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.687587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43ee5-9434-4e49-a7a1-f297722f5e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.688358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db43ee5-9434-4e49-a7a1-f297722f5e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.690043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db43ee5-9434-4e49-a7a1-f297722f5e42 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.700451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 932/1851] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:20.724785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db43ee5-9434-4e49-a7a1-f297722f5e42 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.738637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db43ee5-9434-4e49-a7a1-f297722f5e42 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.744028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5a83-3af4-408e-bdef-0f1e57dd57ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.744982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5a83-3af4-408e-bdef-0f1e57dd57ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.745355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5a83-3af4-408e-bdef-0f1e57dd57ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.745735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5a83-3af4-408e-bdef-0f1e57dd57ad admin admin] PATH_INFO: `/v3/projects/c0a664464ae14db2a5e688c7cc1daa8f/users/32083e0fd4b8471ea019e34c925875f4/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.762731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5a83-3af4-408e-bdef-0f1e57dd57ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a664464ae14db2a5e688c7cc1daa8f, user_id=32083e0fd4b8471ea019e34c925875f4, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.765417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5a83-3af4-408e-bdef-0f1e57dd57ad admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.892800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 920/1852] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:20 2022] PUT /identity/v3/projects/cd7110da00a74c2dbea398f87efc6369/users/e1f3f8fa735747bd96d03bf3e300a56b/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:20.896984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e0f5-d919-4b90-a978-01f1e4f328a6 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.965440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e0f5-d919-4b90-a978-01f1e4f328a6 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:20.970238 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a6a05-5ece-4611-beef-dac262bb7907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:20.970945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a6a05-5ece-4611-beef-dac262bb7907 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:20.971229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a6a05-5ece-4611-beef-dac262bb7907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:20.971509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a6a05-5ece-4611-beef-dac262bb7907 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:20.972247 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a6a05-5ece-4611-beef-dac262bb7907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:20.973891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a6a05-5ece-4611-beef-dac262bb7907 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:20.984411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 921/1853] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:20.988916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a6a05-5ece-4611-beef-dac262bb7907 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:20.995515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 933/1854] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:20 2022] PUT /identity/v3/projects/c0a664464ae14db2a5e688c7cc1daa8f/users/32083e0fd4b8471ea019e34c925875f4/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:21.003392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a6a05-5ece-4611-beef-dac262bb7907 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:21.006612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5a83-3af4-408e-bdef-0f1e57dd57ad admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:21.062736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ed31-75d8-45c5-9bc1-19f377e8e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:21.063690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ed31-75d8-45c5-9bc1-19f377e8e85a admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:21.063980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ed31-75d8-45c5-9bc1-19f377e8e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:21.064563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ed31-75d8-45c5-9bc1-19f377e8e85a admin admin] PATH_INFO: `/v3/projects/cd7110da00a74c2dbea398f87efc6369/users/e1f3f8fa735747bd96d03bf3e300a56b/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:21.066510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463ed31-75d8-45c5-9bc1-19f377e8e85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7110da00a74c2dbea398f87efc6369, user_id=e1f3f8fa735747bd96d03bf3e300a56b, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:21.069571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463ed31-75d8-45c5-9bc1-19f377e8e85a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:21.079317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5a83-3af4-408e-bdef-0f1e57dd57ad admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:21.083404 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 922/1855] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:20 2022] PUT /identity/v3/projects/cd7110da00a74c2dbea398f87efc6369/users/e1f3f8fa735747bd96d03bf3e300a56b/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:21.095661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df515d-3b9f-4f23-ada1-4aafb9f66b76 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:21.096259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df515d-3b9f-4f23-ada1-4aafb9f66b76 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:21.096610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df515d-3b9f-4f23-ada1-4aafb9f66b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:21.142686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-17df515d-3b9f-4f23-ada1-4aafb9f66b76 None None] MFA Rules not processed for user `e1f3f8fa735747bd96d03bf3e300a56b`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:21.149990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-17df515d-3b9f-4f23-ada1-4aafb9f66b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:21.168096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46f5a2-6a82-4dc7-8617-4a10ffe35420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:21.170090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f5a2-6a82-4dc7-8617-4a10ffe35420 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:21.170459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f5a2-6a82-4dc7-8617-4a10ffe35420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:21.170648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46f5a2-6a82-4dc7-8617-4a10ffe35420 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:21.171724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46f5a2-6a82-4dc7-8617-4a10ffe35420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:21.175662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46f5a2-6a82-4dc7-8617-4a10ffe35420 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:21.205952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 934/1856] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:21.210805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46f5a2-6a82-4dc7-8617-4a10ffe35420 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:21.224477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46f5a2-6a82-4dc7-8617-4a10ffe35420 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:21.229706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd0927-55c0-4573-9e85-686981ee6bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:21.231401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd0927-55c0-4573-9e85-686981ee6bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:21.231680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd0927-55c0-4573-9e85-686981ee6bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:21.231984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd0927-55c0-4573-9e85-686981ee6bbe admin admin] PATH_INFO: `/v3/projects/c0a664464ae14db2a5e688c7cc1daa8f/users/32083e0fd4b8471ea019e34c925875f4/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:21.234554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd0927-55c0-4573-9e85-686981ee6bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a664464ae14db2a5e688c7cc1daa8f, user_id=32083e0fd4b8471ea019e34c925875f4, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:21.237273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd0927-55c0-4573-9e85-686981ee6bbe admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:21.249420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 935/1857] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:21 2022] PUT /identity/v3/projects/c0a664464ae14db2a5e688c7cc1daa8f/users/32083e0fd4b8471ea019e34c925875f4/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:21.268430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bf61-8dd4-40ba-9c71-25a2b3fd42c3 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:21.268430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bf61-8dd4-40ba-9c71-25a2b3fd42c3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:21.268430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bf61-8dd4-40ba-9c71-25a2b3fd42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:21.268661 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 923/1858] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:21.275481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df515d-3b9f-4f23-ada1-4aafb9f66b76 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:21.281274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-17df515d-3b9f-4f23-ada1-4aafb9f66b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:21.294958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a3f2bf61-8dd4-40ba-9c71-25a2b3fd42c3 None None] MFA Rules not processed for user `32083e0fd4b8471ea019e34c925875f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:21.296170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a3f2bf61-8dd4-40ba-9c71-25a2b3fd42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:21.353681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df515d-3b9f-4f23-ada1-4aafb9f66b76 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:21.405417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 936/1859] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:21.406414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2bf61-8dd4-40ba-9c71-25a2b3fd42c3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:21.407826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a3f2bf61-8dd4-40ba-9c71-25a2b3fd42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:21.423259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:21.423931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:21.424218 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:21.424499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:21.489682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:21.491225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:21.494928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2bf61-8dd4-40ba-9c71-25a2b3fd42c3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:21.500002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86226243-cc53-48f6-bdb7-288112690af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:21.501404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86226243-cc53-48f6-bdb7-288112690af9 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:21.501694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86226243-cc53-48f6-bdb7-288112690af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:21.501969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86226243-cc53-48f6-bdb7-288112690af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:21.502837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 924/1860] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:21.518461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86226243-cc53-48f6-bdb7-288112690af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:21.520092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86226243-cc53-48f6-bdb7-288112690af9 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:21.532621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 937/1861] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:23.612898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:23.614438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:23.701646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34da8f-b233-47c8-9277-378d4335d510 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:23.706717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:23.707614 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:23.707889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:23.708163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] PATH_INFO: `/v3/users/f9d96b1c101a4e95824421fc8e9eca26` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:23.709493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d96b1c101a4e95824421fc8e9eca26)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:23.712445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:23.997915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d96b1c101a4e95824421fc8e9eca26'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.020401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86226243-cc53-48f6-bdb7-288112690af9 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:24.020883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d96b1c101a4e95824421fc8e9eca26'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.022019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d96b1c101a4e95824421fc8e9eca26'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.022709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d96b1c101a4e95824421fc8e9eca26'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.029147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86226243-cc53-48f6-bdb7-288112690af9 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:24.037804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:24.037804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:24.037804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:24.037804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] PATH_INFO: `/v3/users/8f9b4e698fac4734b65709c355a53f9a` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:24.040928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9b4e698fac4734b65709c355a53f9a)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:24.044854 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:24.135546 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6a9c7b74-2571-4960-95e5-068b9e66d54d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d96b1c101a4e95824421fc8e9eca26'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.150998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 925/1862] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:23 2022] DELETE /identity/v3/users/f9d96b1c101a4e95824421fc8e9eca26 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:24.155463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe578-e578-4e8d-a06a-317032b081fb None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:24.155780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe578-e578-4e8d-a06a-317032b081fb None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:24.156434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe578-e578-4e8d-a06a-317032b081fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:24.211098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-282fe578-e578-4e8d-a06a-317032b081fb None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:24.212570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-282fe578-e578-4e8d-a06a-317032b081fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:24.292470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 926/1863] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:24.306845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fe578-e578-4e8d-a06a-317032b081fb None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:24.308584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-282fe578-e578-4e8d-a06a-317032b081fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:24.392426 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9b4e698fac4734b65709c355a53f9a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.422017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fe578-e578-4e8d-a06a-317032b081fb None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:24.426407 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fac0d-385f-4706-96c1-e7ebb9b9addf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:24.427343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fac0d-385f-4706-96c1-e7ebb9b9addf service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:24.427704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fac0d-385f-4706-96c1-e7ebb9b9addf service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:24.427990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fac0d-385f-4706-96c1-e7ebb9b9addf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:24.431888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9b4e698fac4734b65709c355a53f9a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.433378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9b4e698fac4734b65709c355a53f9a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.435406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9b4e698fac4734b65709c355a53f9a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.440891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fac0d-385f-4706-96c1-e7ebb9b9addf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:24.442704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fac0d-385f-4706-96c1-e7ebb9b9addf service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:24.455264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 927/1864] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:24.581548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9b4e698fac4734b65709c355a53f9a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:24.596508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 938/1865] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:24 2022] DELETE /identity/v3/users/8f9b4e698fac4734b65709c355a53f9a => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:24.601680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5567-749e-4dc7-a3ae-d4142aad2ce6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:24.601973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5567-749e-4dc7-a3ae-d4142aad2ce6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:24.602251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5567-749e-4dc7-a3ae-d4142aad2ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:24.623025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-884d5567-749e-4dc7-a3ae-d4142aad2ce6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:24.624296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-884d5567-749e-4dc7-a3ae-d4142aad2ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:24.688135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 928/1866] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:24.698828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:24.700843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:24.795217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d63d3-627f-48af-bad6-0b17b297f334 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:24.799799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e01d-2b23-4ffd-9dc0-5d734284d72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:24.800539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e01d-2b23-4ffd-9dc0-5d734284d72f service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:24.800851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e01d-2b23-4ffd-9dc0-5d734284d72f service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:24.801146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e01d-2b23-4ffd-9dc0-5d734284d72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:24.811858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18e01d-2b23-4ffd-9dc0-5d734284d72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:24.813514 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18e01d-2b23-4ffd-9dc0-5d734284d72f service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:24.827299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 939/1867] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:25.161769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d5567-749e-4dc7-a3ae-d4142aad2ce6 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:25.166728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-884d5567-749e-4dc7-a3ae-d4142aad2ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:25.184534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d5567-749e-4dc7-a3ae-d4142aad2ce6 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:25.190124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:25.191113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:25.191534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:25.191915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] PATH_INFO: `/v3/projects/5e24550c13464acca90651f453c25492` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:25.193354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e24550c13464acca90651f453c25492)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:25.195789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:25.345595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e24550c13464acca90651f453c25492', 'request_id': 'req-57634ac9-405f-48d4-94d3-e3f7640250dc'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:25.476571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e24550c13464acca90651f453c25492', 'request_id': 'req-57634ac9-405f-48d4-94d3-e3f7640250dc'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:25.476571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e24550c13464acca90651f453c25492', 'request_id': 'req-57634ac9-405f-48d4-94d3-e3f7640250dc'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:25.490717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] The token cache is being invalidate because project 5e24550c13464acca90651f453c25492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:25.491112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:25.491891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:25.493873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 929/1868] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:25 2022] DELETE /identity/v3/projects/5e24550c13464acca90651f453c25492 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:25.498251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e01d-2b23-4ffd-9dc0-5d734284d72f service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:25.521156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e01d-2b23-4ffd-9dc0-5d734284d72f service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:25.626753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:25.627791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:25.628135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:25.628486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] PATH_INFO: `/v3/users/13cd9ab2e1af4c73b4eeb4559a32568c` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:25.629792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cd9ab2e1af4c73b4eeb4559a32568c)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:25.632053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:25.703521 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:25.705045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:25.749540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57634ac9-405f-48d4-94d3-e3f7640250dc admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:25.762917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:25.763807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:25.764087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:25.764520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] PATH_INFO: `/v3/projects/5ab48450db584c37b392a7db81a5d0e4` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:25.766077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab48450db584c37b392a7db81a5d0e4)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:25.768373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:26.069336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cd9ab2e1af4c73b4eeb4559a32568c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.069448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab48450db584c37b392a7db81a5d0e4', 'request_id': 'req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.078093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cd9ab2e1af4c73b4eeb4559a32568c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.078846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cd9ab2e1af4c73b4eeb4559a32568c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.079503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cd9ab2e1af4c73b4eeb4559a32568c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.226141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab48450db584c37b392a7db81a5d0e4', 'request_id': 'req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.232847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab48450db584c37b392a7db81a5d0e4', 'request_id': 'req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.244396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] The token cache is being invalidate because project 5ab48450db584c37b392a7db81a5d0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:26.244690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.245378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.247074 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 930/1869] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:25 2022] DELETE /identity/v3/projects/5ab48450db584c37b392a7db81a5d0e4 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:26.251382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:26.252783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:26.323251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8842c6-f9f0-4b20-83d9-da59bc1d962f admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:26.328596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:26.329515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:26.329796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:26.330067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] PATH_INFO: `/v3/users/32083e0fd4b8471ea019e34c925875f4` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:26.331289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32083e0fd4b8471ea019e34c925875f4)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:26.333215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:26.341487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cd9ab2e1af4c73b4eeb4559a32568c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.354892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 940/1870] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:25 2022] DELETE /identity/v3/users/13cd9ab2e1af4c73b4eeb4559a32568c => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:26.731055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32083e0fd4b8471ea019e34c925875f4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.768360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32083e0fd4b8471ea019e34c925875f4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.769489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32083e0fd4b8471ea019e34c925875f4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.770214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32083e0fd4b8471ea019e34c925875f4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.850850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d5b68ba2-539c-423c-8528-11f8c731e1b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32083e0fd4b8471ea019e34c925875f4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:26.863275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:26.866695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 931/1871] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:26 2022] DELETE /identity/v3/users/32083e0fd4b8471ea019e34c925875f4 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:26.867484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:26.993204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7077d3-4b73-4c17-912e-721a488a56c1 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:27.087918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:27.088940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:27.089309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:27.089596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] PATH_INFO: `/v3/projects/5188fcf160164b488fff745174713f20` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:27.093047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5188fcf160164b488fff745174713f20)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:27.095395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:27.289827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5188fcf160164b488fff745174713f20', 'request_id': 'req-ebf67f40-eddd-4b18-8e14-89da7bbb772a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.443919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5188fcf160164b488fff745174713f20', 'request_id': 'req-ebf67f40-eddd-4b18-8e14-89da7bbb772a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.452007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5188fcf160164b488fff745174713f20', 'request_id': 'req-ebf67f40-eddd-4b18-8e14-89da7bbb772a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.471872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] The token cache is being invalidate because project 5188fcf160164b488fff745174713f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:27.472273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.473070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-ebf67f40-eddd-4b18-8e14-89da7bbb772a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.475045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 941/1872] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:26 2022] DELETE /identity/v3/projects/5188fcf160164b488fff745174713f20 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:27.490926 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efcbc-5e80-4be4-833b-231cab0b0a6a None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:27.491219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efcbc-5e80-4be4-833b-231cab0b0a6a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:27.491658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efcbc-5e80-4be4-833b-231cab0b0a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:27.511212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ba5efcbc-5e80-4be4-833b-231cab0b0a6a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:27.512557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ba5efcbc-5e80-4be4-833b-231cab0b0a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:27.583721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 932/1873] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:27.592303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028ba9-6c37-4c80-afb5-7575e75f36fa None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:27.592598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028ba9-6c37-4c80-afb5-7575e75f36fa None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:27.592878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028ba9-6c37-4c80-afb5-7575e75f36fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:27.612474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-21028ba9-6c37-4c80-afb5-7575e75f36fa None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:27.613905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-21028ba9-6c37-4c80-afb5-7575e75f36fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:27.627383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 942/1874] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:27.631232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5efcbc-5e80-4be4-833b-231cab0b0a6a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:27.642334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5efcbc-5e80-4be4-833b-231cab0b0a6a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:27.647066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:27.647773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:27.648054 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:27.651058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:27.651058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:27.651058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:27.651058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:27.665574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 933/1875] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:27.671248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21028ba9-6c37-4c80-afb5-7575e75f36fa None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:27.681586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21028ba9-6c37-4c80-afb5-7575e75f36fa None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:27.691373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:27.692478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495f34-a813-4e23-bff2-d30e674e3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:27.693600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495f34-a813-4e23-bff2-d30e674e3f5b admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:27.694149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495f34-a813-4e23-bff2-d30e674e3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:27.694647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495f34-a813-4e23-bff2-d30e674e3f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:27.694846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:27.695536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495f34-a813-4e23-bff2-d30e674e3f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:27.698162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495f34-a813-4e23-bff2-d30e674e3f5b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:27.720020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5c4d7-6c52-4078-b9c1-363827c71358 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:27.725415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:27.726320 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:27.726609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:27.726886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] PATH_INFO: `/v3/projects/c0a664464ae14db2a5e688c7cc1daa8f` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:27.728138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a664464ae14db2a5e688c7cc1daa8f)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:27.730112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:27.848000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 943/1876] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:27.852436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495f34-a813-4e23-bff2-d30e674e3f5b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:27.860199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a664464ae14db2a5e688c7cc1daa8f', 'request_id': 'req-2344ead5-4bc8-487c-86d4-a63be0456f4a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.922400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495f34-a813-4e23-bff2-d30e674e3f5b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:27.933266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:27.934565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:27.934997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:27.935348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:27.936418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:27.939369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:27.941196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a664464ae14db2a5e688c7cc1daa8f', 'request_id': 'req-2344ead5-4bc8-487c-86d4-a63be0456f4a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.951346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a664464ae14db2a5e688c7cc1daa8f', 'request_id': 'req-2344ead5-4bc8-487c-86d4-a63be0456f4a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.981892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] The token cache is being invalidate because project c0a664464ae14db2a5e688c7cc1daa8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:27.992938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.994951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2344ead5-4bc8-487c-86d4-a63be0456f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:27.997911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 934/1877] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:27 2022] DELETE /identity/v3/projects/c0a664464ae14db2a5e688c7cc1daa8f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:28.003852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4520-e34b-4f7e-aa30-ff2162bfeffe None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.004925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4520-e34b-4f7e-aa30-ff2162bfeffe None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.005212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f4520-e34b-4f7e-aa30-ff2162bfeffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.033806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-597f4520-e34b-4f7e-aa30-ff2162bfeffe None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:28.035102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-597f4520-e34b-4f7e-aa30-ff2162bfeffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:28.052287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 935/1878] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:28.062050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a37f4-b6fc-48e6-a866-f4255380420f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.062341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a37f4-b6fc-48e6-a866-f4255380420f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.062620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a37f4-b6fc-48e6-a866-f4255380420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.064293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 944/1879] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:27 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:28.066944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.068592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:28.083564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989aed2-a784-4047-be43-301425bc4f74 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.086795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-c12a37f4-b6fc-48e6-a866-f4255380420f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:28.088541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c12a37f4-b6fc-48e6-a866-f4255380420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:28.088741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa06da1-8c45-4be5-8b24-21dc8d3a071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.089488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa06da1-8c45-4be5-8b24-21dc8d3a071e admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.089960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa06da1-8c45-4be5-8b24-21dc8d3a071e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.091001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa06da1-8c45-4be5-8b24-21dc8d3a071e admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.092405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa06da1-8c45-4be5-8b24-21dc8d3a071e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.094333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa06da1-8c45-4be5-8b24-21dc8d3a071e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.102028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 936/1880] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:28.109367 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a37f4-b6fc-48e6-a866-f4255380420f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.110966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 945/1881] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:28.115288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa06da1-8c45-4be5-8b24-21dc8d3a071e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.120951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a37f4-b6fc-48e6-a866-f4255380420f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.127495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa06da1-8c45-4be5-8b24-21dc8d3a071e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.127703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.128580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.128958 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.129410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.130379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:28.130798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.132876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.133985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e2d05-3c11-4bbc-9bc4-f978401d0185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.134383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e2d05-3c11-4bbc-9bc4-f978401d0185 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.134838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e2d05-3c11-4bbc-9bc4-f978401d0185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.135261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e2d05-3c11-4bbc-9bc4-f978401d0185 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.136171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e2d05-3c11-4bbc-9bc4-f978401d0185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.139540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e2d05-3c11-4bbc-9bc4-f978401d0185 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.151130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 937/1882] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:28.156335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.156908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 946/1883] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:28.160940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e2d05-3c11-4bbc-9bc4-f978401d0185 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.169949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaf346-8d6e-4f93-9c8f-3b4615a43c75 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.172508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e2d05-3c11-4bbc-9bc4-f978401d0185 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.179118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956f4f4-492f-40af-8ad6-9996464edbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.191357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956f4f4-492f-40af-8ad6-9996464edbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.191357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956f4f4-492f-40af-8ad6-9996464edbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.191357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956f4f4-492f-40af-8ad6-9996464edbfb admin admin] PATH_INFO: `/v3/projects/0c1cc36d98404fec9e08d280cfcfa29e/users/3e7df7626f5a436d8231bc248b434736/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.192189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe43e-5d85-4092-aa85-293fd2b234e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.192189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe43e-5d85-4092-aa85-293fd2b234e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.192189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe43e-5d85-4092-aa85-293fd2b234e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.192189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbe43e-5d85-4092-aa85-293fd2b234e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.192527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbe43e-5d85-4092-aa85-293fd2b234e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.192527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbe43e-5d85-4092-aa85-293fd2b234e3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.205741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956f4f4-492f-40af-8ad6-9996464edbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1cc36d98404fec9e08d280cfcfa29e, user_id=3e7df7626f5a436d8231bc248b434736, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.208737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956f4f4-492f-40af-8ad6-9996464edbfb admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.400972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 938/1884] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:28 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:28.405706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe43e-5d85-4092-aa85-293fd2b234e3 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.421947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 947/1885] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:28 2022] PUT /identity/v3/projects/0c1cc36d98404fec9e08d280cfcfa29e/users/3e7df7626f5a436d8231bc248b434736/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:28.425263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1a7b0-fd69-40eb-833b-e8dc69111e95 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.425572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1a7b0-fd69-40eb-833b-e8dc69111e95 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.425832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1a7b0-fd69-40eb-833b-e8dc69111e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.468914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-73f1a7b0-fd69-40eb-833b-e8dc69111e95 None None] MFA Rules not processed for user `3e7df7626f5a436d8231bc248b434736`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:28.470185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-73f1a7b0-fd69-40eb-833b-e8dc69111e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:28.524576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbe43e-5d85-4092-aa85-293fd2b234e3 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.552605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689deafb-bb8c-4dc0-859f-5b7707ba65a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.553343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689deafb-bb8c-4dc0-859f-5b7707ba65a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.553649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689deafb-bb8c-4dc0-859f-5b7707ba65a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.553931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689deafb-bb8c-4dc0-859f-5b7707ba65a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.556183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689deafb-bb8c-4dc0-859f-5b7707ba65a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.557798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689deafb-bb8c-4dc0-859f-5b7707ba65a9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.586532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 948/1886] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:28.592370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1a7b0-fd69-40eb-833b-e8dc69111e95 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.604807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1a7b0-fd69-40eb-833b-e8dc69111e95 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.610586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be80b05-6ee5-4986-82b5-89460c74adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.611349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80b05-6ee5-4986-82b5-89460c74adda admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.611660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80b05-6ee5-4986-82b5-89460c74adda admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.611938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80b05-6ee5-4986-82b5-89460c74adda admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.612636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be80b05-6ee5-4986-82b5-89460c74adda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.614660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be80b05-6ee5-4986-82b5-89460c74adda admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.704613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 939/1887] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:28 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:28.704613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689deafb-bb8c-4dc0-859f-5b7707ba65a9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.711177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689deafb-bb8c-4dc0-859f-5b7707ba65a9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.716235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913e78c-29b0-429b-bbc0-b070111fe885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.716892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913e78c-29b0-429b-bbc0-b070111fe885 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.717171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913e78c-29b0-429b-bbc0-b070111fe885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.717533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913e78c-29b0-429b-bbc0-b070111fe885 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.718263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913e78c-29b0-429b-bbc0-b070111fe885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.720204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913e78c-29b0-429b-bbc0-b070111fe885 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.732349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 940/1888] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:28.736323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913e78c-29b0-429b-bbc0-b070111fe885 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.747284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913e78c-29b0-429b-bbc0-b070111fe885 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.752289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dd31b-7815-48e2-baa4-c7167b23ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.752936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dd31b-7815-48e2-baa4-c7167b23ef01 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.753281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dd31b-7815-48e2-baa4-c7167b23ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.753565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dd31b-7815-48e2-baa4-c7167b23ef01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.754312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dd31b-7815-48e2-baa4-c7167b23ef01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.756200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dd31b-7815-48e2-baa4-c7167b23ef01 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.769759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 941/1889] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:28.773850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dd31b-7815-48e2-baa4-c7167b23ef01 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.785479 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dd31b-7815-48e2-baa4-c7167b23ef01 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.790135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76649-e315-4217-89a3-ae9adf7aa669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.791034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76649-e315-4217-89a3-ae9adf7aa669 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.791316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76649-e315-4217-89a3-ae9adf7aa669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.791594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76649-e315-4217-89a3-ae9adf7aa669 admin admin] PATH_INFO: `/v3/projects/bb13d0526b844795b7cab18a1911603b/users/1ff6ffea0aa94dafa8ae321bbc19460e/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.807752 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76649-e315-4217-89a3-ae9adf7aa669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb13d0526b844795b7cab18a1911603b, user_id=1ff6ffea0aa94dafa8ae321bbc19460e, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.811230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76649-e315-4217-89a3-ae9adf7aa669 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:28.811858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 949/1890] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:28 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:28.815819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be80b05-6ee5-4986-82b5-89460c74adda admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:28.883792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be80b05-6ee5-4986-82b5-89460c74adda admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:28.891420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 942/1891] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:28 2022] PUT /identity/v3/projects/bb13d0526b844795b7cab18a1911603b/users/1ff6ffea0aa94dafa8ae321bbc19460e/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:28.902286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2225f9-c803-41b2-99d7-de0b6efe87d8 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.902704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2225f9-c803-41b2-99d7-de0b6efe87d8 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.903234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2225f9-c803-41b2-99d7-de0b6efe87d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.937695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ec2225f9-c803-41b2-99d7-de0b6efe87d8 None None] MFA Rules not processed for user `1ff6ffea0aa94dafa8ae321bbc19460e`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:28.939341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ec2225f9-c803-41b2-99d7-de0b6efe87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:28.950148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcd775-f882-4150-98f6-8e13f936833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:28.950861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcd775-f882-4150-98f6-8e13f936833a admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:28.951284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcd775-f882-4150-98f6-8e13f936833a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:28.951570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcd775-f882-4150-98f6-8e13f936833a admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:28.952425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcd775-f882-4150-98f6-8e13f936833a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:28.954427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcd775-f882-4150-98f6-8e13f936833a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:29.023077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 943/1892] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:29.043215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2225f9-c803-41b2-99d7-de0b6efe87d8 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:29.045892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ec2225f9-c803-41b2-99d7-de0b6efe87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:29.128781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2225f9-c803-41b2-99d7-de0b6efe87d8 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:29.133100 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d96159b7fb49c08b1f5c014d26f79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:29.133883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:29.134246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:29.134651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:29.141058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 950/1893] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:28 2022] POST /identity/v3/users => generated 300 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:29.144843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcd775-f882-4150-98f6-8e13f936833a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:29.151429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:29.154059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:29.159170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcd775-f882-4150-98f6-8e13f936833a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:29.165389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 944/1894] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:29.174977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6a14e-eaed-48a9-b416-8d1e434bd92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:29.176120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6a14e-eaed-48a9-b416-8d1e434bd92a admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:29.176542 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6a14e-eaed-48a9-b416-8d1e434bd92a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:29.177733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6a14e-eaed-48a9-b416-8d1e434bd92a admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:29.178631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6a14e-eaed-48a9-b416-8d1e434bd92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:29.180659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6a14e-eaed-48a9-b416-8d1e434bd92a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:29.193291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:29.194624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:29.207616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 951/1895] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:29.211680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6a14e-eaed-48a9-b416-8d1e434bd92a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:29.225312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6a14e-eaed-48a9-b416-8d1e434bd92a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:29.231462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1ccb-8fcc-414a-a2fc-177a155cedcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:29.232186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1ccb-8fcc-414a-a2fc-177a155cedcb admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:29.232503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1ccb-8fcc-414a-a2fc-177a155cedcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:29.232945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1ccb-8fcc-414a-a2fc-177a155cedcb admin admin] PATH_INFO: `/v3/projects/d18e6c1edc41458599b407d323efbdc7/users/c384c7291ea34b848e69b22e7c63eba1/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:29.261143 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d1ccb-8fcc-414a-a2fc-177a155cedcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18e6c1edc41458599b407d323efbdc7, user_id=c384c7291ea34b848e69b22e7c63eba1, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:29.266303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d1ccb-8fcc-414a-a2fc-177a155cedcb admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:29.272179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8685502-df33-4b4b-9907-76284870df87 service glance] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:29.276091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:29.276824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:29.277562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:29.277562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:29.279921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:29.370642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:29.372766 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:29.384203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 945/1896] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:29.467664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 952/1897] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:29 2022] PUT /identity/v3/projects/d18e6c1edc41458599b407d323efbdc7/users/c384c7291ea34b848e69b22e7c63eba1/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:29.472208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:29.500051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75655b5-9879-4368-9241-a6e90438d25a service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:29.587398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ece4e-ffcb-4005-bd60-b67bbcf5e9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:29.588101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ece4e-ffcb-4005-bd60-b67bbcf5e9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:29.594849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ece4e-ffcb-4005-bd60-b67bbcf5e9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:29.594849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ece4e-ffcb-4005-bd60-b67bbcf5e9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:29.594849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ece4e-ffcb-4005-bd60-b67bbcf5e9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:29.594849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ece4e-ffcb-4005-bd60-b67bbcf5e9b8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:29.609977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 946/1898] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:29.611641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1ccb-8fcc-414a-a2fc-177a155cedcb admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:29.622469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1ccb-8fcc-414a-a2fc-177a155cedcb admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:29.628122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339914da-f6a4-405c-aeec-a1793f97c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:29.629342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339914da-f6a4-405c-aeec-a1793f97c609 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:29.629699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339914da-f6a4-405c-aeec-a1793f97c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:29.635276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339914da-f6a4-405c-aeec-a1793f97c609 admin admin] PATH_INFO: `/v3/projects/d18e6c1edc41458599b407d323efbdc7/users/c384c7291ea34b848e69b22e7c63eba1/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:29.635276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339914da-f6a4-405c-aeec-a1793f97c609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18e6c1edc41458599b407d323efbdc7, user_id=c384c7291ea34b848e69b22e7c63eba1, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:29.637887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339914da-f6a4-405c-aeec-a1793f97c609 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:29.650904 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 953/1899] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:29 2022] PUT /identity/v3/projects/d18e6c1edc41458599b407d323efbdc7/users/c384c7291ea34b848e69b22e7c63eba1/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:29.674416 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a3b1-0c78-466d-b08e-bf7031ba4643 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:29.674911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a3b1-0c78-466d-b08e-bf7031ba4643 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:29.675024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44a3b1-0c78-466d-b08e-bf7031ba4643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:29.708881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-db44a3b1-0c78-466d-b08e-bf7031ba4643 None None] MFA Rules not processed for user `c384c7291ea34b848e69b22e7c63eba1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:29.710450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-db44a3b1-0c78-466d-b08e-bf7031ba4643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:29.812798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 947/1900] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:30.381644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339914da-f6a4-405c-aeec-a1793f97c609 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:30.519120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339914da-f6a4-405c-aeec-a1793f97c609 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:30.522164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf2de-21e2-4d30-91f9-6ea36ccf9bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:30.522845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf2de-21e2-4d30-91f9-6ea36ccf9bbb service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:30.523130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf2de-21e2-4d30-91f9-6ea36ccf9bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:30.523412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf2de-21e2-4d30-91f9-6ea36ccf9bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:30.535094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf2de-21e2-4d30-91f9-6ea36ccf9bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:30.537440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf2de-21e2-4d30-91f9-6ea36ccf9bbb service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:30.547568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 954/1901] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:33.858828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a3b1-0c78-466d-b08e-bf7031ba4643 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:33.921765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44a3b1-0c78-466d-b08e-bf7031ba4643 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:33.926251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:33.927162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:33.927358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:33.927762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] PATH_INFO: `/v3/users/3e7df7626f5a436d8231bc248b434736` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:33.928961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7df7626f5a436d8231bc248b434736)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:33.930916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:34.247770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7df7626f5a436d8231bc248b434736'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:34.260456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7df7626f5a436d8231bc248b434736'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:34.261379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7df7626f5a436d8231bc248b434736'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:34.262404 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7df7626f5a436d8231bc248b434736'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:34.431184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7df7626f5a436d8231bc248b434736'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:34.444937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 948/1902] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:33 2022] DELETE /identity/v3/users/3e7df7626f5a436d8231bc248b434736 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:34.454724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7454e7-f148-447a-bc9a-b9e9d3961429 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:34.455280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7454e7-f148-447a-bc9a-b9e9d3961429 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:34.455280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7454e7-f148-447a-bc9a-b9e9d3961429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:34.473710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5b7454e7-f148-447a-bc9a-b9e9d3961429 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:34.474936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5b7454e7-f148-447a-bc9a-b9e9d3961429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:34.536686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 955/1903] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:34.548364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:34.550022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:34.613490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f659e-e4d8-49fb-af29-8a61221e66e2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:34.617150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718e20e-55fe-4ca0-bb5d-ad203c2f3fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:34.617826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718e20e-55fe-4ca0-bb5d-ad203c2f3fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:34.618109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718e20e-55fe-4ca0-bb5d-ad203c2f3fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:34.618470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718e20e-55fe-4ca0-bb5d-ad203c2f3fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:34.627924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718e20e-55fe-4ca0-bb5d-ad203c2f3fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:34.629391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718e20e-55fe-4ca0-bb5d-ad203c2f3fa6 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:34.639225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 949/1904] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:35.193785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7454e7-f148-447a-bc9a-b9e9d3961429 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:35.195189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5b7454e7-f148-447a-bc9a-b9e9d3961429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:35.211293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7454e7-f148-447a-bc9a-b9e9d3961429 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:35.217136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:35.218085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:35.218371 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:35.218659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] PATH_INFO: `/v3/projects/0c1cc36d98404fec9e08d280cfcfa29e` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:35.220663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c1cc36d98404fec9e08d280cfcfa29e)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:35.222771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:35.442183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c1cc36d98404fec9e08d280cfcfa29e', 'request_id': 'req-942407d9-e5b5-44d2-9a02-89525bf62b96'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:35.582000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c1cc36d98404fec9e08d280cfcfa29e', 'request_id': 'req-942407d9-e5b5-44d2-9a02-89525bf62b96'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:35.589044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c1cc36d98404fec9e08d280cfcfa29e', 'request_id': 'req-942407d9-e5b5-44d2-9a02-89525bf62b96'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:35.601502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] The token cache is being invalidate because project 0c1cc36d98404fec9e08d280cfcfa29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:35.601861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:35.602513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:35.604064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 956/1905] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:35 2022] DELETE /identity/v3/projects/0c1cc36d98404fec9e08d280cfcfa29e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:35.608386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718e20e-55fe-4ca0-bb5d-ad203c2f3fa6 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:35.618336 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718e20e-55fe-4ca0-bb5d-ad203c2f3fa6 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:35.681049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:35.681974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:35.682270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:35.682548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] PATH_INFO: `/v3/users/c384c7291ea34b848e69b22e7c63eba1` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:35.683786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c384c7291ea34b848e69b22e7c63eba1)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:35.685803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:35.954297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c384c7291ea34b848e69b22e7c63eba1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:35.966505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c384c7291ea34b848e69b22e7c63eba1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:35.967246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c384c7291ea34b848e69b22e7c63eba1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:35.967875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c384c7291ea34b848e69b22e7c63eba1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:36.072217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c51c3c9a-05a4-479b-bbac-d2edc09e629b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c384c7291ea34b848e69b22e7c63eba1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:36.085689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 950/1906] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:35 2022] DELETE /identity/v3/users/c384c7291ea34b848e69b22e7c63eba1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:36.582741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:36.585144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:36.602419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942407d9-e5b5-44d2-9a02-89525bf62b96 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:36.663041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:36.663908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:36.664194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:36.664495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] PATH_INFO: `/v3/projects/d18e6c1edc41458599b407d323efbdc7` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:36.665744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18e6c1edc41458599b407d323efbdc7)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:36.667710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:36.846664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18e6c1edc41458599b407d323efbdc7', 'request_id': 'req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:37.162554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18e6c1edc41458599b407d323efbdc7', 'request_id': 'req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:37.168928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18e6c1edc41458599b407d323efbdc7', 'request_id': 'req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:37.180456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] The token cache is being invalidate because project d18e6c1edc41458599b407d323efbdc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:37.180855 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:37.181515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fb50b10-5c11-4cb9-aaf6-d359b7af89ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:37.183150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 957/1907] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:36 2022] DELETE /identity/v3/projects/d18e6c1edc41458599b407d323efbdc7 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:37.189102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccb157-37b9-487d-b063-0eeb7d3c561e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:37.189618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccb157-37b9-487d-b063-0eeb7d3c561e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:37.189751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccb157-37b9-487d-b063-0eeb7d3c561e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:37.208345 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-aeccb157-37b9-487d-b063-0eeb7d3c561e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:37.223034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-aeccb157-37b9-487d-b063-0eeb7d3c561e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:37.272113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 951/1908] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:37.280779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c435-e6ab-4a7b-899b-a7e0862feb74 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:37.281071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c435-e6ab-4a7b-899b-a7e0862feb74 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:37.281398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c435-e6ab-4a7b-899b-a7e0862feb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:37.301751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b351c435-e6ab-4a7b-899b-a7e0862feb74 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:37.303135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b351c435-e6ab-4a7b-899b-a7e0862feb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:37.312209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 958/1909] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:37.317891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccb157-37b9-487d-b063-0eeb7d3c561e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:37.327972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccb157-37b9-487d-b063-0eeb7d3c561e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:37.332994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:37.333677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:37.333986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:37.334266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:37.335000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:37.335307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:37.337040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:37.351151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 952/1910] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:37.356264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351c435-e6ab-4a7b-899b-a7e0862feb74 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:37.366343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351c435-e6ab-4a7b-899b-a7e0862feb74 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:37.371012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3dae8-10fa-456d-a4d3-2cdd72f02e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:37.372143 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3dae8-10fa-456d-a4d3-2cdd72f02e7d admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:37.372425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3dae8-10fa-456d-a4d3-2cdd72f02e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:37.372703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3dae8-10fa-456d-a4d3-2cdd72f02e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:37.373434 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3dae8-10fa-456d-a4d3-2cdd72f02e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:37.375355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3dae8-10fa-456d-a4d3-2cdd72f02e7d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:37.565731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 959/1911] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:37 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:37.579826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:37.598918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611220e3-1791-440a-b68c-f74b6af109eb admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:37.695959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7248-471d-4f77-8bd0-01d4985cc2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:37.696694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7248-471d-4f77-8bd0-01d4985cc2ca admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:37.696852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7248-471d-4f77-8bd0-01d4985cc2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:37.697135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7248-471d-4f77-8bd0-01d4985cc2ca admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:37.697861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f7248-471d-4f77-8bd0-01d4985cc2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:37.700374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f7248-471d-4f77-8bd0-01d4985cc2ca admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:37.850608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 953/1912] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:37 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:37.856006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3dae8-10fa-456d-a4d3-2cdd72f02e7d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:37.867274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3dae8-10fa-456d-a4d3-2cdd72f02e7d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:37.874435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d219c-3945-45a7-a518-2dd18164249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:37.875112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d219c-3945-45a7-a518-2dd18164249a admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:37.876105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d219c-3945-45a7-a518-2dd18164249a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:37.876430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d219c-3945-45a7-a518-2dd18164249a admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:37.877365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d219c-3945-45a7-a518-2dd18164249a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:37.879171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d219c-3945-45a7-a518-2dd18164249a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:37.897725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 960/1913] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:37.899488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7248-471d-4f77-8bd0-01d4985cc2ca admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:37.912434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7248-471d-4f77-8bd0-01d4985cc2ca admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:37.918311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aaf0e-d458-4101-ade1-f226ecb3daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:37.919126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aaf0e-d458-4101-ade1-f226ecb3daff admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:37.919445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aaf0e-d458-4101-ade1-f226ecb3daff admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:37.919724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aaf0e-d458-4101-ade1-f226ecb3daff admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:37.920490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aaf0e-d458-4101-ade1-f226ecb3daff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:37.922209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aaf0e-d458-4101-ade1-f226ecb3daff admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:37.939566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 954/1914] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:37.941343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d219c-3945-45a7-a518-2dd18164249a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:37.954431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d219c-3945-45a7-a518-2dd18164249a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:37.962408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:37.963880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:37.964163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:37.964677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] PATH_INFO: `/v3/projects/2fcdbdb8406442f280ff61ae3a2bf064/users/4ed4d4853fa64915b616d0a3fdc6e697/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:37.990879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcdbdb8406442f280ff61ae3a2bf064, user_id=4ed4d4853fa64915b616d0a3fdc6e697, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:37.996619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:38.096115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 961/1915] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:37 2022] PUT /identity/v3/projects/2fcdbdb8406442f280ff61ae3a2bf064/users/4ed4d4853fa64915b616d0a3fdc6e697/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:38.107346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3db68c-dfec-4b1c-9bf0-b437123c6418 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:38.107633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3db68c-dfec-4b1c-9bf0-b437123c6418 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:38.107906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3db68c-dfec-4b1c-9bf0-b437123c6418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:38.144309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-5c3db68c-dfec-4b1c-9bf0-b437123c6418 None None] MFA Rules not processed for user `4ed4d4853fa64915b616d0a3fdc6e697`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:38.145785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5c3db68c-dfec-4b1c-9bf0-b437123c6418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:38.220022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 955/1916] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:38.232203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:38.234004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:38.302206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7237d2c-b295-495c-a46f-0c34ff1eaa6f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:38.306388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574cea3-564e-451c-b960-2de706550eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:38.307060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574cea3-564e-451c-b960-2de706550eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:38.307350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574cea3-564e-451c-b960-2de706550eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:38.307637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574cea3-564e-451c-b960-2de706550eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:38.318746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574cea3-564e-451c-b960-2de706550eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:38.320254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574cea3-564e-451c-b960-2de706550eb3 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:38.331819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 962/1917] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:38.357341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3db68c-dfec-4b1c-9bf0-b437123c6418 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:38.439669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3db68c-dfec-4b1c-9bf0-b437123c6418 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:38.446319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:38.447258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:38.447547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:38.447822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] PATH_INFO: `/v3/users/4ed4d4853fa64915b616d0a3fdc6e697` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:38.449088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed4d4853fa64915b616d0a3fdc6e697)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:38.451839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:38.709807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed4d4853fa64915b616d0a3fdc6e697'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:38.722588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed4d4853fa64915b616d0a3fdc6e697'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:38.723388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed4d4853fa64915b616d0a3fdc6e697'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:38.723910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed4d4853fa64915b616d0a3fdc6e697'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:38.866405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed4d4853fa64915b616d0a3fdc6e697'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:38.881804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 956/1918] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:38 2022] DELETE /identity/v3/users/4ed4d4853fa64915b616d0a3fdc6e697 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:38.888378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e93be-3c97-491d-91ee-2945be9d2588 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:38.888852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e93be-3c97-491d-91ee-2945be9d2588 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:38.888971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e93be-3c97-491d-91ee-2945be9d2588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:38.907005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-543e93be-3c97-491d-91ee-2945be9d2588 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:38.908199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-543e93be-3c97-491d-91ee-2945be9d2588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:38.971414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 963/1919] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:38.981533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:38.982999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:39.043230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e078-317f-4d37-aacb-73311bc82528 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:39.046963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac473f-1b69-402d-9708-a78124c67397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:39.051372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac473f-1b69-402d-9708-a78124c67397 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:39.051372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac473f-1b69-402d-9708-a78124c67397 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:39.051372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac473f-1b69-402d-9708-a78124c67397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:39.059705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac473f-1b69-402d-9708-a78124c67397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:39.061162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac473f-1b69-402d-9708-a78124c67397 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:39.071736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 957/1920] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:39.725910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e93be-3c97-491d-91ee-2945be9d2588 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:39.727523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-543e93be-3c97-491d-91ee-2945be9d2588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:39.746903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e93be-3c97-491d-91ee-2945be9d2588 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:39.749802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:39.775252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:39.775252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:39.775252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] PATH_INFO: `/v3/projects/2fcdbdb8406442f280ff61ae3a2bf064` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:39.775252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcdbdb8406442f280ff61ae3a2bf064)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:39.775252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:39.977114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcdbdb8406442f280ff61ae3a2bf064', 'request_id': 'req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:40.156890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcdbdb8406442f280ff61ae3a2bf064', 'request_id': 'req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:40.164260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcdbdb8406442f280ff61ae3a2bf064', 'request_id': 'req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:40.184885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] The token cache is being invalidate because project 2fcdbdb8406442f280ff61ae3a2bf064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:40.184885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:40.184885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bb9d02fb-7cca-4c4b-8c6b-46d63dc6884a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:40.184885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 964/1921] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:39 2022] DELETE /identity/v3/projects/2fcdbdb8406442f280ff61ae3a2bf064 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:40.189457 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332073ee-e9ed-49ae-a599-b7c9e5a4eeb0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:40.189980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332073ee-e9ed-49ae-a599-b7c9e5a4eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:40.190081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332073ee-e9ed-49ae-a599-b7c9e5a4eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:40.210311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-332073ee-e9ed-49ae-a599-b7c9e5a4eeb0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:40.211611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-332073ee-e9ed-49ae-a599-b7c9e5a4eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:40.282894 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 958/1922] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:40.291893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d628ae3-525f-4a6f-9be4-c0dd59af5815 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:40.292181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d628ae3-525f-4a6f-9be4-c0dd59af5815 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:40.292462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d628ae3-525f-4a6f-9be4-c0dd59af5815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:40.323085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-6d628ae3-525f-4a6f-9be4-c0dd59af5815 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:40.326520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6d628ae3-525f-4a6f-9be4-c0dd59af5815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:40.338120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 965/1923] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:40.343136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332073ee-e9ed-49ae-a599-b7c9e5a4eeb0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:40.353771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332073ee-e9ed-49ae-a599-b7c9e5a4eeb0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:40.358946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:40.363762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:40.363762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:40.363762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:40.363762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:40.363762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:40.363762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:40.392806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 959/1924] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:40.393991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d628ae3-525f-4a6f-9be4-c0dd59af5815 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:40.403791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d628ae3-525f-4a6f-9be4-c0dd59af5815 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:40.408777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:40.409535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:40.409822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:40.410096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:40.410804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:40.413036 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:40.533428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 966/1925] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:40 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:40.544327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:40.555196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5083bb6-39d6-42f7-a50d-4c002dfdfb1d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:40.621931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2857a-4fdc-45e5-b237-a7216ac70f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:40.622622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2857a-4fdc-45e5-b237-a7216ac70f85 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:40.622928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2857a-4fdc-45e5-b237-a7216ac70f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:40.623179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2857a-4fdc-45e5-b237-a7216ac70f85 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:40.623865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2857a-4fdc-45e5-b237-a7216ac70f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:40.626151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2857a-4fdc-45e5-b237-a7216ac70f85 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:40.867341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:40.869230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:40.884094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730a17-9d93-4b07-9fae-8e71f4e12952 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:40.890659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:40.891708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:40.891994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:40.892263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] PATH_INFO: `/v3/users/70eb175678a04c519c155606a52793fc` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:40.893972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70eb175678a04c519c155606a52793fc)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:40.899054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:40.910499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 960/1926] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:40 2022] POST /identity/v3/users => generated 288 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:40.915112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2857a-4fdc-45e5-b237-a7216ac70f85 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:40.926239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2857a-4fdc-45e5-b237-a7216ac70f85 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:40.932019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe91e7-6468-4e4b-a239-e4fbef36c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:40.932793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe91e7-6468-4e4b-a239-e4fbef36c21d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:40.933177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe91e7-6468-4e4b-a239-e4fbef36c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:40.933663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe91e7-6468-4e4b-a239-e4fbef36c21d admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:40.934802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe91e7-6468-4e4b-a239-e4fbef36c21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:40.936783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe91e7-6468-4e4b-a239-e4fbef36c21d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:40.953307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 961/1927] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:40.957702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe91e7-6468-4e4b-a239-e4fbef36c21d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:40.968734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe91e7-6468-4e4b-a239-e4fbef36c21d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:40.973581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc5d07-5ea4-431f-bbd2-629b1f3b9ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:40.974244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5d07-5ea4-431f-bbd2-629b1f3b9ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:40.974525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5d07-5ea4-431f-bbd2-629b1f3b9ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:40.974802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5d07-5ea4-431f-bbd2-629b1f3b9ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:40.975529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc5d07-5ea4-431f-bbd2-629b1f3b9ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:40.977124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc5d07-5ea4-431f-bbd2-629b1f3b9ab9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:40.988673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 962/1928] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:40.992985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc5d07-5ea4-431f-bbd2-629b1f3b9ab9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:41.003533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc5d07-5ea4-431f-bbd2-629b1f3b9ab9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:41.008842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133d201-cc00-4d8b-8102-695e1b1d9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:41.009799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d201-cc00-4d8b-8102-695e1b1d9870 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:41.010080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d201-cc00-4d8b-8102-695e1b1d9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:41.010364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d201-cc00-4d8b-8102-695e1b1d9870 admin admin] PATH_INFO: `/v3/projects/95db888da14a4d04b01b687155509e1c/users/c197c6fdb0b543ac9518ea932c78be79/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:41.026255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133d201-cc00-4d8b-8102-695e1b1d9870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95db888da14a4d04b01b687155509e1c, user_id=c197c6fdb0b543ac9518ea932c78be79, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:41.028935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133d201-cc00-4d8b-8102-695e1b1d9870 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:41.198467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 963/1929] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:40 2022] PUT /identity/v3/projects/95db888da14a4d04b01b687155509e1c/users/c197c6fdb0b543ac9518ea932c78be79/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:41.210003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a70a-4eea-4df6-a215-0c83160ee45e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:41.210293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a70a-4eea-4df6-a215-0c83160ee45e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:41.210566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46a70a-4eea-4df6-a215-0c83160ee45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:41.241740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4a46a70a-4eea-4df6-a215-0c83160ee45e None None] MFA Rules not processed for user `c197c6fdb0b543ac9518ea932c78be79`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:41.243163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4a46a70a-4eea-4df6-a215-0c83160ee45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:41.281981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70eb175678a04c519c155606a52793fc'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:41.295492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70eb175678a04c519c155606a52793fc'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:41.296269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70eb175678a04c519c155606a52793fc'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:41.297017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70eb175678a04c519c155606a52793fc'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:41.320739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 964/1930] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:41.332890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46a70a-4eea-4df6-a215-0c83160ee45e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:41.334517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4a46a70a-4eea-4df6-a215-0c83160ee45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:41.392069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46a70a-4eea-4df6-a215-0c83160ee45e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:41.392515 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0540f774-c7c5-4c7b-ae2b-5956940b8b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70eb175678a04c519c155606a52793fc'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:41.398655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:41.399331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:41.400795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:41.400795 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:41.411234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 967/1931] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:40 2022] DELETE /identity/v3/users/70eb175678a04c519c155606a52793fc => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:41.412721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:41.414419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:41.415787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c95f-bc46-487d-98b1-edfee10b0754 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:41.416079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c95f-bc46-487d-98b1-edfee10b0754 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:41.416362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c95f-bc46-487d-98b1-edfee10b0754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:41.425137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 965/1932] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:41.436690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ac69c95f-bc46-487d-98b1-edfee10b0754 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:41.440810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ac69c95f-bc46-487d-98b1-edfee10b0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:41.507654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 968/1933] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:41.521062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:41.521284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:41.587339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d350a-4146-4064-a7e0-160c9bbd18f1 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:41.639970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972217-5395-4ebc-838f-ae662482c506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:41.640638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972217-5395-4ebc-838f-ae662482c506 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:41.640925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972217-5395-4ebc-838f-ae662482c506 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:41.641232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972217-5395-4ebc-838f-ae662482c506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:41.651163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972217-5395-4ebc-838f-ae662482c506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:41.652642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972217-5395-4ebc-838f-ae662482c506 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:41.664311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 966/1934] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:42.338043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c95f-bc46-487d-98b1-edfee10b0754 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:42.339554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ac69c95f-bc46-487d-98b1-edfee10b0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:42.352304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c95f-bc46-487d-98b1-edfee10b0754 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:42.362027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:42.362948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:42.363382 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:42.363665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] PATH_INFO: `/v3/projects/136b72dc56bf4d3e9f3b5242cee8f6c5` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:42.364916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136b72dc56bf4d3e9f3b5242cee8f6c5)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:42.366876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:42.541768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136b72dc56bf4d3e9f3b5242cee8f6c5', 'request_id': 'req-a05dcda8-fc25-4f56-8470-9e543da25a00'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:42.666332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136b72dc56bf4d3e9f3b5242cee8f6c5', 'request_id': 'req-a05dcda8-fc25-4f56-8470-9e543da25a00'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:42.673158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136b72dc56bf4d3e9f3b5242cee8f6c5', 'request_id': 'req-a05dcda8-fc25-4f56-8470-9e543da25a00'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:42.685017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] The token cache is being invalidate because project 136b72dc56bf4d3e9f3b5242cee8f6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:42.685346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:42.686016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:42.687562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 969/1935] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:42 2022] DELETE /identity/v3/projects/136b72dc56bf4d3e9f3b5242cee8f6c5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:42.691604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972217-5395-4ebc-838f-ae662482c506 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:42.701510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972217-5395-4ebc-838f-ae662482c506 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:42.765540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:42.766778 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:42.767259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:42.767927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] PATH_INFO: `/v3/users/e1f3f8fa735747bd96d03bf3e300a56b` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:42.772253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f3f8fa735747bd96d03bf3e300a56b)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:42.774253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:43.122209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f3f8fa735747bd96d03bf3e300a56b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:43.134669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f3f8fa735747bd96d03bf3e300a56b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:43.135355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f3f8fa735747bd96d03bf3e300a56b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:43.135966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f3f8fa735747bd96d03bf3e300a56b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:43.513173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f3f8fa735747bd96d03bf3e300a56b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:43.537892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 967/1936] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:42 2022] DELETE /identity/v3/users/e1f3f8fa735747bd96d03bf3e300a56b => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:44.084806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:44.086380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:44.102941 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dcda8-fc25-4f56-8470-9e543da25a00 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:44.164009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:44.164900 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:44.165184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:44.165504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] PATH_INFO: `/v3/projects/cd7110da00a74c2dbea398f87efc6369` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:44.166758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7110da00a74c2dbea398f87efc6369)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:44.169502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:44.174239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:44.175740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:44.189464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b594fc-7695-4ff4-97e5-6b7693993ea9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:44.199408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:44.200347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:44.200631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:44.200932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] PATH_INFO: `/v3/users/4bd063abaedb47b0ab26d8cb0954ec85` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:44.202225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd063abaedb47b0ab26d8cb0954ec85)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:44.204196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:44.546306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd063abaedb47b0ab26d8cb0954ec85'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.550365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7110da00a74c2dbea398f87efc6369', 'request_id': 'req-9fe4385f-425e-418e-9e06-2a2a211d3b14'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.563313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd063abaedb47b0ab26d8cb0954ec85'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.564362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd063abaedb47b0ab26d8cb0954ec85'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.568649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd063abaedb47b0ab26d8cb0954ec85'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.689355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7110da00a74c2dbea398f87efc6369', 'request_id': 'req-9fe4385f-425e-418e-9e06-2a2a211d3b14'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.696229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7110da00a74c2dbea398f87efc6369', 'request_id': 'req-9fe4385f-425e-418e-9e06-2a2a211d3b14'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.714587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] The token cache is being invalidate because project cd7110da00a74c2dbea398f87efc6369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:44.715608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.716322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9fe4385f-425e-418e-9e06-2a2a211d3b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.717992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 970/1937] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:44 2022] DELETE /identity/v3/projects/cd7110da00a74c2dbea398f87efc6369 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:44.724434 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f710506-13b7-4580-a1cf-b292cd2daba9 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:44.724729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f710506-13b7-4580-a1cf-b292cd2daba9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:44.725013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f710506-13b7-4580-a1cf-b292cd2daba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:44.744613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5f710506-13b7-4580-a1cf-b292cd2daba9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:44.745890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5f710506-13b7-4580-a1cf-b292cd2daba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:44.904781 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 971/1938] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:44.906267 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-88f48e13-64da-41f5-b899-cf6cfe35f24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd063abaedb47b0ab26d8cb0954ec85'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:44.906807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e0d2-7616-41b7-ba9c-50ff49cf65e5 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:44.906807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e0d2-7616-41b7-ba9c-50ff49cf65e5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:44.906807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e0d2-7616-41b7-ba9c-50ff49cf65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:44.907012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 968/1939] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:44 2022] DELETE /identity/v3/users/4bd063abaedb47b0ab26d8cb0954ec85 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:44.907012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c792b-7019-42a2-8ca8-5a9d961136dc None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:44.907012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c792b-7019-42a2-8ca8-5a9d961136dc None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:44.907012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c792b-7019-42a2-8ca8-5a9d961136dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:44.907276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1f71e0d2-7616-41b7-ba9c-50ff49cf65e5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:44.907276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1f71e0d2-7616-41b7-ba9c-50ff49cf65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:44.907420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-df7c792b-7019-42a2-8ca8-5a9d961136dc None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:44.907420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-df7c792b-7019-42a2-8ca8-5a9d961136dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:44.927387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 972/1940] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:44.931328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71e0d2-7616-41b7-ba9c-50ff49cf65e5 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:44.941389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71e0d2-7616-41b7-ba9c-50ff49cf65e5 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:44.945917 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:44.946585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:44.946875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:44.947160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:44.947924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:44.948209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:44.948870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 969/1941] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:44.950479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:44.960473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c792b-7019-42a2-8ca8-5a9d961136dc None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:44.962050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-df7c792b-7019-42a2-8ca8-5a9d961136dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:44.966335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 973/1942] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:04:44.967287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:44.978193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59329e4-b9a9-43ba-b01a-5c193911f4e5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:44.983354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec5568-8a54-4287-8b23-51de185551f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:44.984030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec5568-8a54-4287-8b23-51de185551f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:44.984315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec5568-8a54-4287-8b23-51de185551f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:44.984597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec5568-8a54-4287-8b23-51de185551f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:44.985331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec5568-8a54-4287-8b23-51de185551f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:44.987451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec5568-8a54-4287-8b23-51de185551f5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:45.049841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c792b-7019-42a2-8ca8-5a9d961136dc None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:45.054337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35787bb-d4bd-41c2-b53a-5550f4ffcc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:45.054337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35787bb-d4bd-41c2-b53a-5550f4ffcc48 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:45.055161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35787bb-d4bd-41c2-b53a-5550f4ffcc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:45.055161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35787bb-d4bd-41c2-b53a-5550f4ffcc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:45.068520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35787bb-d4bd-41c2-b53a-5550f4ffcc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:45.070086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35787bb-d4bd-41c2-b53a-5550f4ffcc48 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:45.083328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 970/1943] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:45.089501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 974/1944] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:44 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:45.094345 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35787bb-d4bd-41c2-b53a-5550f4ffcc48 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:45.106471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35787bb-d4bd-41c2-b53a-5550f4ffcc48 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:45.191606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12babea-42ad-416d-946a-4e77fcf749f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:45.192369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12babea-42ad-416d-946a-4e77fcf749f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:45.192774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12babea-42ad-416d-946a-4e77fcf749f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:45.193150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12babea-42ad-416d-946a-4e77fcf749f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:45.193975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12babea-42ad-416d-946a-4e77fcf749f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:45.196079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12babea-42ad-416d-946a-4e77fcf749f9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:45.317681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 971/1945] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:45 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:45.322060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec5568-8a54-4287-8b23-51de185551f5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:45.332242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec5568-8a54-4287-8b23-51de185551f5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:45.336953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c1fd-2f8e-4ef7-894a-3af00cf668aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:45.337650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c1fd-2f8e-4ef7-894a-3af00cf668aa admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:45.337931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c1fd-2f8e-4ef7-894a-3af00cf668aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:45.338207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c1fd-2f8e-4ef7-894a-3af00cf668aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:45.338936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c1fd-2f8e-4ef7-894a-3af00cf668aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:45.340585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c1fd-2f8e-4ef7-894a-3af00cf668aa admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:45.350897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 975/1946] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:45.360174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12babea-42ad-416d-946a-4e77fcf749f9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:45.372082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12babea-42ad-416d-946a-4e77fcf749f9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:45.379908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b43cb-9706-4661-989d-7890b92adfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:45.380594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b43cb-9706-4661-989d-7890b92adfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:45.380880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b43cb-9706-4661-989d-7890b92adfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:45.381155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b43cb-9706-4661-989d-7890b92adfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:45.384656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b43cb-9706-4661-989d-7890b92adfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:45.384656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b43cb-9706-4661-989d-7890b92adfe1 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:45.398980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 972/1947] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:45.400473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c1fd-2f8e-4ef7-894a-3af00cf668aa admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:45.411601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c1fd-2f8e-4ef7-894a-3af00cf668aa admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:45.416383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0a5cb-7fab-434f-8dad-5ae2b5bb6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:45.417384 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a5cb-7fab-434f-8dad-5ae2b5bb6ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:45.417735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a5cb-7fab-434f-8dad-5ae2b5bb6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:45.418187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a5cb-7fab-434f-8dad-5ae2b5bb6ec9 admin admin] PATH_INFO: `/v3/projects/bc880d93f02e4186b2662a3badebb437/users/98ec541b44464a5c9cb6284c06f9d6ed/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:45.433607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0a5cb-7fab-434f-8dad-5ae2b5bb6ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc880d93f02e4186b2662a3badebb437, user_id=98ec541b44464a5c9cb6284c06f9d6ed, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:45.436367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0a5cb-7fab-434f-8dad-5ae2b5bb6ec9 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:45.583325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 976/1948] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:45 2022] PUT /identity/v3/projects/bc880d93f02e4186b2662a3badebb437/users/98ec541b44464a5c9cb6284c06f9d6ed/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:45.596641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73ab4-6004-4de1-a32b-742ee39deb38 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:45.597573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73ab4-6004-4de1-a32b-742ee39deb38 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:45.598325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73ab4-6004-4de1-a32b-742ee39deb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:45.651912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-23d73ab4-6004-4de1-a32b-742ee39deb38 None None] MFA Rules not processed for user `98ec541b44464a5c9cb6284c06f9d6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:45.655048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-23d73ab4-6004-4de1-a32b-742ee39deb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:45.773323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 973/1949] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:45.774746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0a5cb-7fab-434f-8dad-5ae2b5bb6ec9 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:45.863569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0a5cb-7fab-434f-8dad-5ae2b5bb6ec9 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:45.869766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821c679-b240-4aa3-ae34-9b12401118b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:45.870449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821c679-b240-4aa3-ae34-9b12401118b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:45.870735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821c679-b240-4aa3-ae34-9b12401118b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:45.871589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821c679-b240-4aa3-ae34-9b12401118b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:45.872530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821c679-b240-4aa3-ae34-9b12401118b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:45.874480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821c679-b240-4aa3-ae34-9b12401118b6 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:45.988371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d73ab4-6004-4de1-a32b-742ee39deb38 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:45.988371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-23d73ab4-6004-4de1-a32b-742ee39deb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:45.999091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d73ab4-6004-4de1-a32b-742ee39deb38 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:46.005082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:46.006448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:46.006626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:46.006910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] PATH_INFO: `/v3/projects/835191c086b64391b7fb6ad87f7ba200` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:46.008767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=835191c086b64391b7fb6ad87f7ba200)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:46.010842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:46.024176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 977/1950] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:45 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:46.028619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821c679-b240-4aa3-ae34-9b12401118b6 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:46.113796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821c679-b240-4aa3-ae34-9b12401118b6 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:46.118877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:46.119539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:46.119819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:46.120095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:46.120781 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:46.123727 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:46.162053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835191c086b64391b7fb6ad87f7ba200', 'request_id': 'req-433e6f2d-9822-4cf5-8c89-87985eb3e64e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.198311 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 978/1951] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:46 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:46.199516 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:46.201625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:46.215161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1873d1-6d7a-4fd2-916c-27408cdddb0d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:46.277179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:46.278262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:46.278547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:46.278825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] PATH_INFO: `/v3/users/d41ed3ce637d48109c8d149303da2ddd` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:46.279155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835191c086b64391b7fb6ad87f7ba200', 'request_id': 'req-433e6f2d-9822-4cf5-8c89-87985eb3e64e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.280232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41ed3ce637d48109c8d149303da2ddd)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:46.282802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:46.287056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835191c086b64391b7fb6ad87f7ba200', 'request_id': 'req-433e6f2d-9822-4cf5-8c89-87985eb3e64e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.299982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] The token cache is being invalidate because project 835191c086b64391b7fb6ad87f7ba200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:46.300342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.300934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.302803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 974/1952] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:45 2022] DELETE /identity/v3/projects/835191c086b64391b7fb6ad87f7ba200 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:46.303500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:46.305188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:46.322911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e6f2d-9822-4cf5-8c89-87985eb3e64e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:46.328475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:46.329146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:46.329480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:46.329759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:46.330505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:46.332133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:46.343684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 975/1953] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:46.344720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:46.346350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:46.363727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b12858-2792-41a5-a829-a3be05939200 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:46.369964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:46.371127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:46.371565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:46.371845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] PATH_INFO: `/v3/users/352a574782ce4da69f9f76dd61d8ad8f` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:46.373861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352a574782ce4da69f9f76dd61d8ad8f)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:46.377165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:46.602221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41ed3ce637d48109c8d149303da2ddd'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.615123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41ed3ce637d48109c8d149303da2ddd'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.615880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41ed3ce637d48109c8d149303da2ddd'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.616495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41ed3ce637d48109c8d149303da2ddd'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.677689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352a574782ce4da69f9f76dd61d8ad8f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.691657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352a574782ce4da69f9f76dd61d8ad8f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.692488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352a574782ce4da69f9f76dd61d8ad8f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.693405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352a574782ce4da69f9f76dd61d8ad8f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.695381 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41ed3ce637d48109c8d149303da2ddd'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.720075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 979/1954] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:46 2022] DELETE /identity/v3/users/d41ed3ce637d48109c8d149303da2ddd => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:46.721118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:46.722513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:46.797657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352a574782ce4da69f9f76dd61d8ad8f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:46.799895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3d9c-e8f7-4855-994c-76659ec63d6f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:46.805563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:46.806461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:46.806748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:46.807022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] PATH_INFO: `/v3/projects/2b8fa094b4e14650868a0b1ad6b2b474/users/0fce4146d18a470097c7b14dc4c8d63c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:46.815556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 976/1955] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:46 2022] DELETE /identity/v3/users/352a574782ce4da69f9f76dd61d8ad8f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:46.815556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:46.815556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:46.823528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8fa094b4e14650868a0b1ad6b2b474, user_id=0fce4146d18a470097c7b14dc4c8d63c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:46.827060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:46.908917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f8ed-519c-4277-aadc-1f848fa9ac77 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:46.914219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:46.915140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:46.915419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:46.915761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] PATH_INFO: `/v3/users/c197c6fdb0b543ac9518ea932c78be79` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:46.917333 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c197c6fdb0b543ac9518ea932c78be79)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:46.919987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:46.945936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 980/1956] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:46 2022] PUT /identity/v3/projects/2b8fa094b4e14650868a0b1ad6b2b474/users/0fce4146d18a470097c7b14dc4c8d63c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:46.950431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:46.952082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.019790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483e7fc-848c-4970-9d3d-ac29e09228cb admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:47.025180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:47.026031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.026318 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.026595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.027392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:47.029545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:47.046745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 981/1957] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:47.050212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:47.050212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.066125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300559f-748e-4ddf-ad70-400d47da5ff5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:47.072103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:47.073024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.073334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.078687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] PATH_INFO: `/v3/projects/ac9f2ac674ab4b5e87bfdd3bafacec37` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.078687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9f2ac674ab4b5e87bfdd3bafacec37)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:47.078687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:47.166937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c197c6fdb0b543ac9518ea932c78be79'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.181130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c197c6fdb0b543ac9518ea932c78be79'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.182135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c197c6fdb0b543ac9518ea932c78be79'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.182811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c197c6fdb0b543ac9518ea932c78be79'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.240224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9f2ac674ab4b5e87bfdd3bafacec37', 'request_id': 'req-63337c85-53ca-4778-b070-20a8c9cfeb76'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.289324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c197c6fdb0b543ac9518ea932c78be79'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.305982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 977/1958] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:46 2022] DELETE /identity/v3/users/c197c6fdb0b543ac9518ea932c78be79 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:47.306742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:47.308077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.384286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65692cd3-0a90-4d82-bed7-62bbdf4c8ef5 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:47.391162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98796661-adfe-4fce-8a0d-5ef1adfb837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:47.391162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796661-adfe-4fce-8a0d-5ef1adfb837a admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.391410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796661-adfe-4fce-8a0d-5ef1adfb837a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.391537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796661-adfe-4fce-8a0d-5ef1adfb837a admin admin] PATH_INFO: `/v3/projects/2b8fa094b4e14650868a0b1ad6b2b474/users/0fce4146d18a470097c7b14dc4c8d63c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.393630 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98796661-adfe-4fce-8a0d-5ef1adfb837a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8fa094b4e14650868a0b1ad6b2b474, user_id=0fce4146d18a470097c7b14dc4c8d63c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:47.396420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98796661-adfe-4fce-8a0d-5ef1adfb837a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:47.407980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 978/1959] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:47 2022] PUT /identity/v3/projects/2b8fa094b4e14650868a0b1ad6b2b474/users/0fce4146d18a470097c7b14dc4c8d63c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:47.409322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c029a3-311e-4ad5-b462-eb2a4d1ec54b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.409617 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c029a3-311e-4ad5-b462-eb2a4d1ec54b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.409902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c029a3-311e-4ad5-b462-eb2a4d1ec54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.428565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-14c029a3-311e-4ad5-b462-eb2a4d1ec54b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:47.430499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-14c029a3-311e-4ad5-b462-eb2a4d1ec54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.431424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9f2ac674ab4b5e87bfdd3bafacec37', 'request_id': 'req-63337c85-53ca-4778-b070-20a8c9cfeb76'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.439247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9f2ac674ab4b5e87bfdd3bafacec37', 'request_id': 'req-63337c85-53ca-4778-b070-20a8c9cfeb76'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.453344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] The token cache is being invalidate because project ac9f2ac674ab4b5e87bfdd3bafacec37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:47.453677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.454297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.456011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 982/1960] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:47 2022] DELETE /identity/v3/projects/ac9f2ac674ab4b5e87bfdd3bafacec37 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:47.456733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:47.460285 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.492872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 979/1961] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:47.494694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8665d-948f-4572-8225-dddaf937be6f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.494991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8665d-948f-4572-8225-dddaf937be6f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.495271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8665d-948f-4572-8225-dddaf937be6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.532007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-14b8665d-948f-4572-8225-dddaf937be6f None None] MFA Rules not processed for user `0fce4146d18a470097c7b14dc4c8d63c`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:47.533313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-14b8665d-948f-4572-8225-dddaf937be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.542544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337c85-53ca-4778-b070-20a8c9cfeb76 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:47.548122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:47.548984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.549293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.549569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] PATH_INFO: `/v3/projects/e2a8ef7c573d4f9b9879ee9ae8cc90af` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.550752 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a8ef7c573d4f9b9879ee9ae8cc90af)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:47.552738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:47.618166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 980/1962] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:47.622359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e837595-4680-4442-9ac3-fe69313b3354 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.622702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e837595-4680-4442-9ac3-fe69313b3354 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.622984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e837595-4680-4442-9ac3-fe69313b3354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.647808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-5e837595-4680-4442-9ac3-fe69313b3354 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:47.649045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5e837595-4680-4442-9ac3-fe69313b3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.660468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 981/1963] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:47.661843 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e837595-4680-4442-9ac3-fe69313b3354 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:47.663330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5e837595-4680-4442-9ac3-fe69313b3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.681369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a8ef7c573d4f9b9879ee9ae8cc90af', 'request_id': 'req-4a30d06a-1c01-43e8-8466-b04a5e251bd8'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.724958 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e837595-4680-4442-9ac3-fe69313b3354 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:47.776540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69394aaf-9869-4747-8ef7-41db5b89d197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:47.777761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394aaf-9869-4747-8ef7-41db5b89d197 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.778112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394aaf-9869-4747-8ef7-41db5b89d197 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.778393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394aaf-9869-4747-8ef7-41db5b89d197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.792048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a8ef7c573d4f9b9879ee9ae8cc90af', 'request_id': 'req-4a30d06a-1c01-43e8-8466-b04a5e251bd8'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.800809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a8ef7c573d4f9b9879ee9ae8cc90af', 'request_id': 'req-4a30d06a-1c01-43e8-8466-b04a5e251bd8'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.811282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] The token cache is being invalidate because project e2a8ef7c573d4f9b9879ee9ae8cc90af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:47.811624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.813088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:47.814986 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 983/1964] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:47 2022] DELETE /identity/v3/projects/e2a8ef7c573d4f9b9879ee9ae8cc90af => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:47.815772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:47.817153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.851983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69394aaf-9869-4747-8ef7-41db5b89d197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:47.853713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69394aaf-9869-4747-8ef7-41db5b89d197 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:47.864697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 982/1965] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:47.866036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177c413-e612-4ec9-8828-0326e86bacf0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.866329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177c413-e612-4ec9-8828-0326e86bacf0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.866625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177c413-e612-4ec9-8828-0326e86bacf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.877056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30d06a-1c01-43e8-8466-b04a5e251bd8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:47.886575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0a2f2-8a45-4e64-9a48-712e718cb69d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:47.886774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0a2f2-8a45-4e64-9a48-712e718cb69d service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.887170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0a2f2-8a45-4e64-9a48-712e718cb69d service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.887579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0a2f2-8a45-4e64-9a48-712e718cb69d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.889133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-9177c413-e612-4ec9-8828-0326e86bacf0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:47.889581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-49e0a2f2-8a45-4e64-9a48-712e718cb69d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.890391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9177c413-e612-4ec9-8828-0326e86bacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.904462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 983/1966] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:47.904462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7b788-6f91-43ed-bba0-45536a5bae67 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.904462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7b788-6f91-43ed-bba0-45536a5bae67 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.904462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7b788-6f91-43ed-bba0-45536a5bae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.930117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-7cc7b788-6f91-43ed-bba0-45536a5bae67 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:47.931329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7cc7b788-6f91-43ed-bba0-45536a5bae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:47.940570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 984/1967] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:47.943571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7b788-6f91-43ed-bba0-45536a5bae67 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:47.955542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7b788-6f91-43ed-bba0-45536a5bae67 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:47.967699 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:47.968383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.968666 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.968942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.969544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0a2f2-8a45-4e64-9a48-712e718cb69d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:47.969719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:47.970031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:47.971057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0a2f2-8a45-4e64-9a48-712e718cb69d service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:47.971650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:47.981921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 984/1968] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:47.985110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18764c-b0bd-4a96-beda-4bea378d8571 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:47.985546 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 985/1969] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:47.985675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18764c-b0bd-4a96-beda-4bea378d8571 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:47.985766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18764c-b0bd-4a96-beda-4bea378d8571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:47.990486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.001129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f716ff9-c99c-48aa-bfb5-0895479ecf1d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.006026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-2f18764c-b0bd-4a96-beda-4bea378d8571 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:48.006380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162c0bc-0a80-4d8c-a9ad-d55643eed7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.007102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162c0bc-0a80-4d8c-a9ad-d55643eed7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.007209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2f18764c-b0bd-4a96-beda-4bea378d8571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:48.007612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162c0bc-0a80-4d8c-a9ad-d55643eed7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.007957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162c0bc-0a80-4d8c-a9ad-d55643eed7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.008704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162c0bc-0a80-4d8c-a9ad-d55643eed7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.010681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162c0bc-0a80-4d8c-a9ad-d55643eed7c8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.015570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 985/1970] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:48.022279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18764c-b0bd-4a96-beda-4bea378d8571 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.032456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18764c-b0bd-4a96-beda-4bea378d8571 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.037232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.037928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.038214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.038492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.039221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:48.039530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.041149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.053454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 986/1971] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:48.057796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.068540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e853897-6120-47f4-963c-c1c25b0a09f1 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.079960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54e73e-fcfa-4304-8a97-da1e40763ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.080876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e73e-fcfa-4304-8a97-da1e40763ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.081295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e73e-fcfa-4304-8a97-da1e40763ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.081670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54e73e-fcfa-4304-8a97-da1e40763ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.082540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54e73e-fcfa-4304-8a97-da1e40763ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.084566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54e73e-fcfa-4304-8a97-da1e40763ef2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.145273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 986/1972] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:47 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:48.148872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162c0bc-0a80-4d8c-a9ad-d55643eed7c8 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.220990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162c0bc-0a80-4d8c-a9ad-d55643eed7c8 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.228465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.229206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.229525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.229807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.230637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.232933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.279336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 987/1973] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:48 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:48.284048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54e73e-fcfa-4304-8a97-da1e40763ef2 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.347619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54e73e-fcfa-4304-8a97-da1e40763ef2 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.352686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a4c02-570b-49e7-b3ec-a5144b7ccab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.353637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a4c02-570b-49e7-b3ec-a5144b7ccab5 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.353929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a4c02-570b-49e7-b3ec-a5144b7ccab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.354283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a4c02-570b-49e7-b3ec-a5144b7ccab5 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.355045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a4c02-570b-49e7-b3ec-a5144b7ccab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.357312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a4c02-570b-49e7-b3ec-a5144b7ccab5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.416393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 987/1974] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:48 2022] POST /identity/v3/users => generated 291 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:48.418499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.419578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:48.431887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c060-c7b4-446b-94cb-45625f188608 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.438978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.439865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.440147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.440421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] PATH_INFO: `/v3/projects/95db888da14a4d04b01b687155509e1c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.441687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95db888da14a4d04b01b687155509e1c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.443577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.458134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 988/1975] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:48 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:48.458134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a4c02-570b-49e7-b3ec-a5144b7ccab5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.462438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a4c02-570b-49e7-b3ec-a5144b7ccab5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.470419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4eb0-54a8-4767-a10b-07743708e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.471173 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4eb0-54a8-4767-a10b-07743708e747 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.471467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4eb0-54a8-4767-a10b-07743708e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.471759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4eb0-54a8-4767-a10b-07743708e747 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.472506 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e4eb0-54a8-4767-a10b-07743708e747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.474198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e4eb0-54a8-4767-a10b-07743708e747 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.485332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 989/1976] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:48.486159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4eb0-54a8-4767-a10b-07743708e747 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.497927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4eb0-54a8-4767-a10b-07743708e747 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.502857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84430cf-74c1-44e5-b6c2-4ec0628845b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.503502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84430cf-74c1-44e5-b6c2-4ec0628845b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.503786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84430cf-74c1-44e5-b6c2-4ec0628845b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.504070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84430cf-74c1-44e5-b6c2-4ec0628845b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.504788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84430cf-74c1-44e5-b6c2-4ec0628845b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.506404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84430cf-74c1-44e5-b6c2-4ec0628845b8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.518713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 990/1977] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:48.518713 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84430cf-74c1-44e5-b6c2-4ec0628845b8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.529706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84430cf-74c1-44e5-b6c2-4ec0628845b8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.537592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bb709-2a04-4b62-86ff-7dee41cec526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.538268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb709-2a04-4b62-86ff-7dee41cec526 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.538552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb709-2a04-4b62-86ff-7dee41cec526 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.538832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb709-2a04-4b62-86ff-7dee41cec526 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.539565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bb709-2a04-4b62-86ff-7dee41cec526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.541161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bb709-2a04-4b62-86ff-7dee41cec526 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.552855 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 991/1978] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:48.553830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bb709-2a04-4b62-86ff-7dee41cec526 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.565823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bb709-2a04-4b62-86ff-7dee41cec526 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.570588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bc31-18a9-4c1a-a773-d0acde0c7089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.571264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bc31-18a9-4c1a-a773-d0acde0c7089 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.571547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bc31-18a9-4c1a-a773-d0acde0c7089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.571826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bc31-18a9-4c1a-a773-d0acde0c7089 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.572560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3bc31-18a9-4c1a-a773-d0acde0c7089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.574985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3bc31-18a9-4c1a-a773-d0acde0c7089 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.586388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 992/1979] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:48.587754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bc31-18a9-4c1a-a773-d0acde0c7089 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.598538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bc31-18a9-4c1a-a773-d0acde0c7089 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.602433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95db888da14a4d04b01b687155509e1c', 'request_id': 'req-947b1b66-ef20-4357-b613-612d380cfbf4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:48.660236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737de53-a190-45aa-b89d-b9c0094b5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.661138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737de53-a190-45aa-b89d-b9c0094b5f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.668591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737de53-a190-45aa-b89d-b9c0094b5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.668591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737de53-a190-45aa-b89d-b9c0094b5f74 admin admin] PATH_INFO: `/v3/projects/8e628b06a0ca4ee4bf45d04395a657ff/users/5987014231084f679a795a88f14ad02e/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.678346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737de53-a190-45aa-b89d-b9c0094b5f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e628b06a0ca4ee4bf45d04395a657ff, user_id=5987014231084f679a795a88f14ad02e, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.681016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737de53-a190-45aa-b89d-b9c0094b5f74 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.694486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95db888da14a4d04b01b687155509e1c', 'request_id': 'req-947b1b66-ef20-4357-b613-612d380cfbf4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:48.700592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95db888da14a4d04b01b687155509e1c', 'request_id': 'req-947b1b66-ef20-4357-b613-612d380cfbf4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:48.713592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] The token cache is being invalidate because project 95db888da14a4d04b01b687155509e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:48.714018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:48.715215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:48.717008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 988/1980] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:48 2022] DELETE /identity/v3/projects/95db888da14a4d04b01b687155509e1c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:48.717872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:48.719146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:48.737664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b1b66-ef20-4357-b613-612d380cfbf4 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:48.737664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b1d66-7872-4f07-bc6a-9ccbe866e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:48.737907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1d66-7872-4f07-bc6a-9ccbe866e1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.738185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1d66-7872-4f07-bc6a-9ccbe866e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.738460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b1d66-7872-4f07-bc6a-9ccbe866e1a0 admin admin] PATH_INFO: `/v3/projects/2f3daa30e4954ddd94e7889883a5dbe6/users/ac9d62863ac84624b4d112e69560a11c/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.755013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b1d66-7872-4f07-bc6a-9ccbe866e1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3daa30e4954ddd94e7889883a5dbe6, user_id=ac9d62863ac84624b4d112e69560a11c, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:48.758136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b1d66-7872-4f07-bc6a-9ccbe866e1a0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:48.798903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 993/1981] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:48 2022] PUT /identity/v3/projects/8e628b06a0ca4ee4bf45d04395a657ff/users/5987014231084f679a795a88f14ad02e/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:48.800383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ccfe6-5243-4b89-9c9c-1226e1739eb9 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.800724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ccfe6-5243-4b89-9c9c-1226e1739eb9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.801074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ccfe6-5243-4b89-9c9c-1226e1739eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.826344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-2b3ccfe6-5243-4b89-9c9c-1226e1739eb9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:48.827562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2b3ccfe6-5243-4b89-9c9c-1226e1739eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:48.901453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 994/1982] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:48.901453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60d02-25f0-4266-8ea8-35b168e96bca None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.901453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60d02-25f0-4266-8ea8-35b168e96bca None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.901453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f60d02-25f0-4266-8ea8-35b168e96bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.920037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 989/1983] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:48 2022] PUT /identity/v3/projects/2f3daa30e4954ddd94e7889883a5dbe6/users/ac9d62863ac84624b4d112e69560a11c/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:48.922490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71b9b7-7402-4c4d-91f4-cc569f18fb39 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:48.923142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-42f60d02-25f0-4266-8ea8-35b168e96bca None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:48.924340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71b9b7-7402-4c4d-91f4-cc569f18fb39 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:48.924454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-42f60d02-25f0-4266-8ea8-35b168e96bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:48.924983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71b9b7-7402-4c4d-91f4-cc569f18fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:48.959410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-fc71b9b7-7402-4c4d-91f4-cc569f18fb39 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:48.960648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-fc71b9b7-7402-4c4d-91f4-cc569f18fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:49.004386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 995/1984] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:49.005918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e14314-4a6c-44c5-a7f7-07dbc8cdcf2a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.006208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e14314-4a6c-44c5-a7f7-07dbc8cdcf2a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.006494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e14314-4a6c-44c5-a7f7-07dbc8cdcf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.037380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-51e14314-4a6c-44c5-a7f7-07dbc8cdcf2a None None] MFA Rules not processed for user `ac9d62863ac84624b4d112e69560a11c`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:49.037914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 990/1985] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:49.038587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-51e14314-4a6c-44c5-a7f7-07dbc8cdcf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:49.038789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71b9b7-7402-4c4d-91f4-cc569f18fb39 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.040160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-fc71b9b7-7402-4c4d-91f4-cc569f18fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:49.113735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 996/1986] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:49.114957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e14314-4a6c-44c5-a7f7-07dbc8cdcf2a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.119654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71b9b7-7402-4c4d-91f4-cc569f18fb39 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.123989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f634f-36f3-4db3-a7ec-483f96565a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.131368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f634f-36f3-4db3-a7ec-483f96565a7d service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.131368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f634f-36f3-4db3-a7ec-483f96565a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.131368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f634f-36f3-4db3-a7ec-483f96565a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.131644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e14314-4a6c-44c5-a7f7-07dbc8cdcf2a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.131744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.132418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.132696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.132968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.133728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:49.134033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.134886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f634f-36f3-4db3-a7ec-483f96565a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.135615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.136302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f634f-36f3-4db3-a7ec-483f96565a7d service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.146874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 991/1987] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:49.147501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f634f-36f3-4db3-a7ec-483f96565a7d service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.150981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 997/1988] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:04:49.152054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.157684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f634f-36f3-4db3-a7ec-483f96565a7d service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.162466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d29bd-f1f9-4a84-b000-51b621a0470d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.169710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc05bf-e256-4026-b72b-8303dd9e0343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.169710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc05bf-e256-4026-b72b-8303dd9e0343 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.169710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc05bf-e256-4026-b72b-8303dd9e0343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.169710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc05bf-e256-4026-b72b-8303dd9e0343 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.170076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06f1ef-d083-4d1e-b1c4-e942191a01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.170194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc05bf-e256-4026-b72b-8303dd9e0343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.170281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f1ef-d083-4d1e-b1c4-e942191a01b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.170281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f1ef-d083-4d1e-b1c4-e942191a01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.170281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06f1ef-d083-4d1e-b1c4-e942191a01b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.170611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06f1ef-d083-4d1e-b1c4-e942191a01b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.172095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc05bf-e256-4026-b72b-8303dd9e0343 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.172470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06f1ef-d083-4d1e-b1c4-e942191a01b3 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.371891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 998/1989] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:49 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:49.378378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 992/1990] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:49 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:49.379640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06f1ef-d083-4d1e-b1c4-e942191a01b3 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.380104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc05bf-e256-4026-b72b-8303dd9e0343 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.457255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06f1ef-d083-4d1e-b1c4-e942191a01b3 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.461638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc05bf-e256-4026-b72b-8303dd9e0343 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.462297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d8f40-b5fb-4d4c-ab1a-fa0dc6ceb21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.462940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d8f40-b5fb-4d4c-ab1a-fa0dc6ceb21e admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.463228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d8f40-b5fb-4d4c-ab1a-fa0dc6ceb21e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.463513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d8f40-b5fb-4d4c-ab1a-fa0dc6ceb21e admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.464219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d8f40-b5fb-4d4c-ab1a-fa0dc6ceb21e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.466379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d8f40-b5fb-4d4c-ab1a-fa0dc6ceb21e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.467488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b359e-b05e-4e70-bcc0-ca0207d4d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.468291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b359e-b05e-4e70-bcc0-ca0207d4d10b admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.468618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b359e-b05e-4e70-bcc0-ca0207d4d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.468902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b359e-b05e-4e70-bcc0-ca0207d4d10b admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.469641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b359e-b05e-4e70-bcc0-ca0207d4d10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.471913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b359e-b05e-4e70-bcc0-ca0207d4d10b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.565301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 999/1991] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:49 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:49.565513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 993/1992] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:49 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:49.569215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d8f40-b5fb-4d4c-ab1a-fa0dc6ceb21e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.570569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b359e-b05e-4e70-bcc0-ca0207d4d10b admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.581007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d8f40-b5fb-4d4c-ab1a-fa0dc6ceb21e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.583538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b359e-b05e-4e70-bcc0-ca0207d4d10b admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.585882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9d34a-ae44-47d3-8cab-e2a630236279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.586555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d34a-ae44-47d3-8cab-e2a630236279 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.586835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d34a-ae44-47d3-8cab-e2a630236279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.587107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d34a-ae44-47d3-8cab-e2a630236279 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.587838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9d34a-ae44-47d3-8cab-e2a630236279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.589501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9d34a-ae44-47d3-8cab-e2a630236279 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.590898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cf11d-3da3-407b-8c1c-b3f5560135f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.592023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cf11d-3da3-407b-8c1c-b3f5560135f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.593618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cf11d-3da3-407b-8c1c-b3f5560135f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.593618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cf11d-3da3-407b-8c1c-b3f5560135f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.593963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cf11d-3da3-407b-8c1c-b3f5560135f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.596000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cf11d-3da3-407b-8c1c-b3f5560135f7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.600401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1000/1993] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:49.604939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9d34a-ae44-47d3-8cab-e2a630236279 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.612590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 994/1994] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:49.614128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cf11d-3da3-407b-8c1c-b3f5560135f7 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.615643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9d34a-ae44-47d3-8cab-e2a630236279 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.620828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a7187-19d3-4c8d-b7e4-8e60a358da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.622214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a7187-19d3-4c8d-b7e4-8e60a358da5a admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.622433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a7187-19d3-4c8d-b7e4-8e60a358da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.622703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a7187-19d3-4c8d-b7e4-8e60a358da5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.623430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a7187-19d3-4c8d-b7e4-8e60a358da5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.625027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a7187-19d3-4c8d-b7e4-8e60a358da5a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.629159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cf11d-3da3-407b-8c1c-b3f5560135f7 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.636119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d56da-3694-48a5-a033-a4199fc83b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.636696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1001/1995] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:49.637162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d56da-3694-48a5-a033-a4199fc83b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.637515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d56da-3694-48a5-a033-a4199fc83b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.637799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d56da-3694-48a5-a033-a4199fc83b91 admin admin] PATH_INFO: `/v3/projects/901d2fffeafd40fcb6fcfe9b1b820675/users/3ec33dd49dc849cb906d453bf3d7e967/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.641592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a7187-19d3-4c8d-b7e4-8e60a358da5a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.651740 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a7187-19d3-4c8d-b7e4-8e60a358da5a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.654722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d56da-3694-48a5-a033-a4199fc83b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901d2fffeafd40fcb6fcfe9b1b820675, user_id=3ec33dd49dc849cb906d453bf3d7e967, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.657123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589fb82-3902-4163-9c8a-94d23d486870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.657339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d56da-3694-48a5-a033-a4199fc83b91 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.658177 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589fb82-3902-4163-9c8a-94d23d486870 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.658528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589fb82-3902-4163-9c8a-94d23d486870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.658868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589fb82-3902-4163-9c8a-94d23d486870 admin admin] PATH_INFO: `/v3/projects/dab88f3b75e34f828b6f5224953a0792/users/e6aabe43b9eb428fbda523bd261c8433/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.674453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589fb82-3902-4163-9c8a-94d23d486870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab88f3b75e34f828b6f5224953a0792, user_id=e6aabe43b9eb428fbda523bd261c8433, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.679612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589fb82-3902-4163-9c8a-94d23d486870 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.770908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 995/1996] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:49 2022] PUT /identity/v3/projects/901d2fffeafd40fcb6fcfe9b1b820675/users/3ec33dd49dc849cb906d453bf3d7e967/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:49.772113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d56da-3694-48a5-a033-a4199fc83b91 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.837700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1002/1997] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:49 2022] PUT /identity/v3/projects/dab88f3b75e34f828b6f5224953a0792/users/e6aabe43b9eb428fbda523bd261c8433/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:49.838847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d56da-3694-48a5-a033-a4199fc83b91 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.848898 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c1ff-d46a-4a61-920b-b79512214876 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.849213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c1ff-d46a-4a61-920b-b79512214876 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.849526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c1ff-d46a-4a61-920b-b79512214876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.887164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f6b7c1ff-d46a-4a61-920b-b79512214876 None None] MFA Rules not processed for user `e6aabe43b9eb428fbda523bd261c8433`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:49.888306 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f6b7c1ff-d46a-4a61-920b-b79512214876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:49.899172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f719c-e80f-4474-b3f5-a0a46253eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.899858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f719c-e80f-4474-b3f5-a0a46253eafa admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.900140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f719c-e80f-4474-b3f5-a0a46253eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.900413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f719c-e80f-4474-b3f5-a0a46253eafa admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.901230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f719c-e80f-4474-b3f5-a0a46253eafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.903476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f719c-e80f-4474-b3f5-a0a46253eafa admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.913949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 996/1998] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:49.919635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f719c-e80f-4474-b3f5-a0a46253eafa admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.929452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f719c-e80f-4474-b3f5-a0a46253eafa admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:49.935322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4ae36-deab-4b7a-9e04-486fb8f62771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:49.936211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4ae36-deab-4b7a-9e04-486fb8f62771 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.936493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4ae36-deab-4b7a-9e04-486fb8f62771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.936765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4ae36-deab-4b7a-9e04-486fb8f62771 admin admin] PATH_INFO: `/v3/projects/901d2fffeafd40fcb6fcfe9b1b820675/users/3ec33dd49dc849cb906d453bf3d7e967/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.938790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4ae36-deab-4b7a-9e04-486fb8f62771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901d2fffeafd40fcb6fcfe9b1b820675, user_id=3ec33dd49dc849cb906d453bf3d7e967, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:49.941519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4ae36-deab-4b7a-9e04-486fb8f62771 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:49.952059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 997/1999] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:49 2022] PUT /identity/v3/projects/901d2fffeafd40fcb6fcfe9b1b820675/users/3ec33dd49dc849cb906d453bf3d7e967/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:49.961099 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1003/2000] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:49.962097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62c87f-a613-40da-8178-3edf9d191adf None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:49.963493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62c87f-a613-40da-8178-3edf9d191adf None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:49.963493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62c87f-a613-40da-8178-3edf9d191adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:49.975819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c1ff-d46a-4a61-920b-b79512214876 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:49.977272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f6b7c1ff-d46a-4a61-920b-b79512214876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:49.999767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-cb62c87f-a613-40da-8178-3edf9d191adf None None] MFA Rules not processed for user `3ec33dd49dc849cb906d453bf3d7e967`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:49.999767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-cb62c87f-a613-40da-8178-3edf9d191adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:50.053522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c1ff-d46a-4a61-920b-b79512214876 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:50.104618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 998/2001] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:50.129192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:50.130115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:50.132709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:50.132709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:50.195900 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62c87f-a613-40da-8178-3edf9d191adf None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:50.204277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-cb62c87f-a613-40da-8178-3edf9d191adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:50.216670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:50.218374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:50.221710 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62c87f-a613-40da-8178-3edf9d191adf None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:50.227757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c4ef-118f-4da6-a088-31fcc2b0afd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:50.228600 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c4ef-118f-4da6-a088-31fcc2b0afd2 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:50.229128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c4ef-118f-4da6-a088-31fcc2b0afd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:50.229533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c4ef-118f-4da6-a088-31fcc2b0afd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:50.231353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1004/2002] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:50.243143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c4ef-118f-4da6-a088-31fcc2b0afd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:50.244762 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c4ef-118f-4da6-a088-31fcc2b0afd2 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:50.257050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 999/2003] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:52.092743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:52.094322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:52.190961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839a85-e0df-4d26-920c-704611e4febc service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:52.192363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c4ef-118f-4da6-a088-31fcc2b0afd2 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:52.202381 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:52.204154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c4ef-118f-4da6-a088-31fcc2b0afd2 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:52.204316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:52.205041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:52.206047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] PATH_INFO: `/v3/users/98ec541b44464a5c9cb6284c06f9d6ed` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:52.208081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ec541b44464a5c9cb6284c06f9d6ed)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:52.210171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:52.215417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:52.216447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:52.222670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:52.222670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] PATH_INFO: `/v3/users/ac9d62863ac84624b4d112e69560a11c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:52.222670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9d62863ac84624b4d112e69560a11c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:52.222670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:52.513074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ec541b44464a5c9cb6284c06f9d6ed'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.530860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ec541b44464a5c9cb6284c06f9d6ed'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.531666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ec541b44464a5c9cb6284c06f9d6ed'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.532278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ec541b44464a5c9cb6284c06f9d6ed'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.611551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9d62863ac84624b4d112e69560a11c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.628042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9d62863ac84624b4d112e69560a11c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.628837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9d62863ac84624b4d112e69560a11c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.629481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9d62863ac84624b4d112e69560a11c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.644016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4dee9c45-3375-4b4e-8ca2-8a43210a734b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ec541b44464a5c9cb6284c06f9d6ed'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.665645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1005/2004] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:52 2022] DELETE /identity/v3/users/98ec541b44464a5c9cb6284c06f9d6ed => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:52.673628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7916e-6f8e-439b-aeab-74f0e66daf49 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:52.674258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7916e-6f8e-439b-aeab-74f0e66daf49 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:52.674785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7916e-6f8e-439b-aeab-74f0e66daf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:52.703324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d7f7916e-6f8e-439b-aeab-74f0e66daf49 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:52.704659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d7f7916e-6f8e-439b-aeab-74f0e66daf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:52.760935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9d62863ac84624b4d112e69560a11c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:52.780085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1006/2005] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:52.789890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1000/2006] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:52 2022] DELETE /identity/v3/users/ac9d62863ac84624b4d112e69560a11c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:52.791828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc096-3aa5-4321-a67f-25a0a60bc519 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:52.793888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:52.795277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc096-3aa5-4321-a67f-25a0a60bc519 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:52.795556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edc096-3aa5-4321-a67f-25a0a60bc519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:52.798263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:52.829799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-06edc096-3aa5-4321-a67f-25a0a60bc519 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:52.832279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-06edc096-3aa5-4321-a67f-25a0a60bc519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:52.901295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ae87-00c4-4ed3-940b-ce0cc1875ed9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:52.914885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:52.915669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:52.915956 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:52.916241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:52.982817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1007/2007] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:53.004703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edc096-3aa5-4321-a67f-25a0a60bc519 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:53.016424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edc096-3aa5-4321-a67f-25a0a60bc519 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:53.020627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:53.021408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:53.021701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:53.021983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:53.034556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:53.036050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:53.049450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1008/2008] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:04:53.050196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:53.054194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:53.073899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1001/2009] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:53.684189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:53.688182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:53.748580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64963da1-dc1d-4e7d-8c8c-eaa711846a2c service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:53.759308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:53.760823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:53.761410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:53.762059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] PATH_INFO: `/v3/projects/2f3daa30e4954ddd94e7889883a5dbe6` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:53.763876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f3daa30e4954ddd94e7889883a5dbe6)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:53.766540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:53.930995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f3daa30e4954ddd94e7889883a5dbe6', 'request_id': 'req-da987fd4-2a93-488b-893b-1f06f09c1f9b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:53.984032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:53.985618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:53.997742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f3daa30e4954ddd94e7889883a5dbe6', 'request_id': 'req-da987fd4-2a93-488b-893b-1f06f09c1f9b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.008355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f3daa30e4954ddd94e7889883a5dbe6', 'request_id': 'req-da987fd4-2a93-488b-893b-1f06f09c1f9b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.015123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09416-45e3-4b9b-94cb-c33736e5c1af service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:54.038837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] The token cache is being invalidate because project 2f3daa30e4954ddd94e7889883a5dbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:54.039140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.039834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.041868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1009/2010] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:53 2022] DELETE /identity/v3/projects/2f3daa30e4954ddd94e7889883a5dbe6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:54.046129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:54.048771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:54.102850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:54.103999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:54.104637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:54.105174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] PATH_INFO: `/v3/projects/bc880d93f02e4186b2662a3badebb437` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:54.107483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc880d93f02e4186b2662a3badebb437)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:54.110528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:54.170192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da987fd4-2a93-488b-893b-1f06f09c1f9b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:54.176911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:54.178596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:54.178893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:54.179184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] PATH_INFO: `/v3/users/3ec33dd49dc849cb906d453bf3d7e967` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:54.181335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec33dd49dc849cb906d453bf3d7e967)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:54.184174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:54.262231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc880d93f02e4186b2662a3badebb437', 'request_id': 'req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.380815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc880d93f02e4186b2662a3badebb437', 'request_id': 'req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.387526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc880d93f02e4186b2662a3badebb437', 'request_id': 'req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.399924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] The token cache is being invalidate because project bc880d93f02e4186b2662a3badebb437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:54.400221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.400879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.405817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1002/2011] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:53 2022] DELETE /identity/v3/projects/bc880d93f02e4186b2662a3badebb437 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:54.406852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:54.408649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:54.427589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec33dd49dc849cb906d453bf3d7e967'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.444969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec33dd49dc849cb906d453bf3d7e967'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.457778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec33dd49dc849cb906d453bf3d7e967'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.459114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec33dd49dc849cb906d453bf3d7e967'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.491672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec38b6c-ab46-4b04-9574-ac4532f78c1e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:54.497827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:54.499163 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:54.499890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:54.500374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] PATH_INFO: `/v3/users/0fce4146d18a470097c7b14dc4c8d63c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:54.502084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fce4146d18a470097c7b14dc4c8d63c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:54.504036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:54.575113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec33dd49dc849cb906d453bf3d7e967'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.593980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1010/2012] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:54 2022] DELETE /identity/v3/users/3ec33dd49dc849cb906d453bf3d7e967 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:54.724773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fce4146d18a470097c7b14dc4c8d63c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.744987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fce4146d18a470097c7b14dc4c8d63c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.746382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fce4146d18a470097c7b14dc4c8d63c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.747326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fce4146d18a470097c7b14dc4c8d63c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.857494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fce4146d18a470097c7b14dc4c8d63c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:54.884105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1003/2013] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:54 2022] DELETE /identity/v3/users/0fce4146d18a470097c7b14dc4c8d63c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:55.295333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:55.298254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:55.403650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63869b-5156-4020-ab1f-51f608bb40ad admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:55.524060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:55.526242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:55.527748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:55.528999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] PATH_INFO: `/v3/projects/901d2fffeafd40fcb6fcfe9b1b820675` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:55.551386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=901d2fffeafd40fcb6fcfe9b1b820675)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:55.557211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:55.696739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:55.698318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:55.727653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9033a2-5b03-47b5-8302-0b9ec8911675 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:55.770133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901d2fffeafd40fcb6fcfe9b1b820675', 'request_id': 'req-a563d287-7234-468b-a740-8078d3b6ba8a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:55.854469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:55.855885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:55.856994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:55.857227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] PATH_INFO: `/v3/projects/2b8fa094b4e14650868a0b1ad6b2b474` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:55.858741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8fa094b4e14650868a0b1ad6b2b474)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:55.860653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:55.900573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901d2fffeafd40fcb6fcfe9b1b820675', 'request_id': 'req-a563d287-7234-468b-a740-8078d3b6ba8a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:55.909992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901d2fffeafd40fcb6fcfe9b1b820675', 'request_id': 'req-a563d287-7234-468b-a740-8078d3b6ba8a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:55.925040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] The token cache is being invalidate because project 901d2fffeafd40fcb6fcfe9b1b820675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:55.925365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:55.926079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-a563d287-7234-468b-a740-8078d3b6ba8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:55.928079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1011/2014] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:55 2022] DELETE /identity/v3/projects/901d2fffeafd40fcb6fcfe9b1b820675 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:55.933630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e072a6-d7c2-4dd7-8273-e9014595330c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:55.934638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e072a6-d7c2-4dd7-8273-e9014595330c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:55.934986 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e072a6-d7c2-4dd7-8273-e9014595330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:55.956476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d9e072a6-d7c2-4dd7-8273-e9014595330c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:55.957743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d9e072a6-d7c2-4dd7-8273-e9014595330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:55.966999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1012/2015] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:55.974754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666a44-7cb6-4c32-b169-aba9e8387d75 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:55.975041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666a44-7cb6-4c32-b169-aba9e8387d75 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:55.975319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3666a44-7cb6-4c32-b169-aba9e8387d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:55.996534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-e3666a44-7cb6-4c32-b169-aba9e8387d75 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:55.997812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e3666a44-7cb6-4c32-b169-aba9e8387d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:56.006275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1013/2016] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:56.010940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666a44-7cb6-4c32-b169-aba9e8387d75 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.021325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3666a44-7cb6-4c32-b169-aba9e8387d75 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:56.039053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:56.039735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.040018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.040295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.041089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:56.044364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:56.046050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:56.063481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1014/2017] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:04:56.064629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.066371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8fa094b4e14650868a0b1ad6b2b474', 'request_id': 'req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:56.079161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514823b6-4a8f-44c8-b50d-61593bc6dade admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:56.165491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:56.166093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.166376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.166655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.169530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8fa094b4e14650868a0b1ad6b2b474', 'request_id': 'req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:56.170885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:56.175841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:56.177197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8fa094b4e14650868a0b1ad6b2b474', 'request_id': 'req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:56.195097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] The token cache is being invalidate because project 2b8fa094b4e14650868a0b1ad6b2b474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:56.197819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:56.199798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-766f0c7c-e9b9-49b8-b785-02a6e0ef535b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:56.219360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1004/2018] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:04:55 2022] DELETE /identity/v3/projects/2b8fa094b4e14650868a0b1ad6b2b474 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:56.223881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8030-0f2e-4b63-b320-6ce5817cbefa None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.224174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8030-0f2e-4b63-b320-6ce5817cbefa None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.224473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8030-0f2e-4b63-b320-6ce5817cbefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.265299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e90a8030-0f2e-4b63-b320-6ce5817cbefa None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:56.266793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e90a8030-0f2e-4b63-b320-6ce5817cbefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:56.278390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1005/2019] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:56.289744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6aca-31d8-4b67-aa4b-7a0798cae389 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.290038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6aca-31d8-4b67-aa4b-7a0798cae389 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.290319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce6aca-31d8-4b67-aa4b-7a0798cae389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.332500 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1015/2020] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:56 2022] POST /identity/v3/projects => generated 355 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:56.337007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-68ce6aca-31d8-4b67-aa4b-7a0798cae389 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:56.338290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-68ce6aca-31d8-4b67-aa4b-7a0798cae389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:56.340563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.344844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:56.584182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1006/2021] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:56.584638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99040-7e66-4cfc-b329-800d7404517b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:56.585755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce6aca-31d8-4b67-aa4b-7a0798cae389 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.591203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56e7a-1729-4e8b-bab0-5f0d8c4e0d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:56.593069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56e7a-1729-4e8b-bab0-5f0d8c4e0d5d admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.593069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56e7a-1729-4e8b-bab0-5f0d8c4e0d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.593069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56e7a-1729-4e8b-bab0-5f0d8c4e0d5d admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.594307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56e7a-1729-4e8b-bab0-5f0d8c4e0d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:56.597319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56e7a-1729-4e8b-bab0-5f0d8c4e0d5d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:56.609977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce6aca-31d8-4b67-aa4b-7a0798cae389 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:56.618742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:56.621944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.622365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.622829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.624164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:04:56.628583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:56.636142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:56.672220 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1007/2022] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:04:56.677116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.707998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffdb4c-4c14-4728-b086-c0aa8daa4136 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:56.736300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1016/2023] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:56 2022] POST /identity/v3/users => generated 278 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:56.736445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750fbbc-cd02-433f-b33d-3906a97f0ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:56.736445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750fbbc-cd02-433f-b33d-3906a97f0ddd admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.736445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750fbbc-cd02-433f-b33d-3906a97f0ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.736445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750fbbc-cd02-433f-b33d-3906a97f0ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.737031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750fbbc-cd02-433f-b33d-3906a97f0ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:56.739407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56e7a-1729-4e8b-bab0-5f0d8c4e0d5d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.739981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750fbbc-cd02-433f-b33d-3906a97f0ddd admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:56.750494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56e7a-1729-4e8b-bab0-5f0d8c4e0d5d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:56.776641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60abe1f-46d0-45f2-aa8c-88921bc4fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:56.777962 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60abe1f-46d0-45f2-aa8c-88921bc4fd2c admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.778372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60abe1f-46d0-45f2-aa8c-88921bc4fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.778767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60abe1f-46d0-45f2-aa8c-88921bc4fd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.780174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60abe1f-46d0-45f2-aa8c-88921bc4fd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:56.781985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60abe1f-46d0-45f2-aa8c-88921bc4fd2c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:56.794069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1017/2024] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:56.797995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60abe1f-46d0-45f2-aa8c-88921bc4fd2c admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.814691 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60abe1f-46d0-45f2-aa8c-88921bc4fd2c admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:56.822906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0eeef-9d2c-4265-8118-5ed73d38b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:56.824301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0eeef-9d2c-4265-8118-5ed73d38b262 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.824801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0eeef-9d2c-4265-8118-5ed73d38b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.825312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0eeef-9d2c-4265-8118-5ed73d38b262 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.826702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0eeef-9d2c-4265-8118-5ed73d38b262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:56.829820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0eeef-9d2c-4265-8118-5ed73d38b262 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:56.847682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1018/2025] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:56.851812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0eeef-9d2c-4265-8118-5ed73d38b262 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.866570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0eeef-9d2c-4265-8118-5ed73d38b262 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:56.874803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ba7bf-2f6c-4440-88cd-1c1556869a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:56.876648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ba7bf-2f6c-4440-88cd-1c1556869a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:56.877163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ba7bf-2f6c-4440-88cd-1c1556869a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:56.877714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ba7bf-2f6c-4440-88cd-1c1556869a91 admin admin] PATH_INFO: `/v3/projects/c691fe96a79b49b39d56078c11085e2d/users/81d32fd8a341423e91841d2565e66b7d/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:56.911410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ba7bf-2f6c-4440-88cd-1c1556869a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c691fe96a79b49b39d56078c11085e2d, user_id=81d32fd8a341423e91841d2565e66b7d, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:56.913123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1008/2026] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:56 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:56.914881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750fbbc-cd02-433f-b33d-3906a97f0ddd admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:56.920747 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ba7bf-2f6c-4440-88cd-1c1556869a91 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.028978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1019/2027] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:56 2022] PUT /identity/v3/projects/c691fe96a79b49b39d56078c11085e2d/users/81d32fd8a341423e91841d2565e66b7d/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:57.039397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750fbbc-cd02-433f-b33d-3906a97f0ddd admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:57.040572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc65a7-da55-42a1-80ac-2c0dd3dc15af None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.040862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc65a7-da55-42a1-80ac-2c0dd3dc15af None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.041140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc65a7-da55-42a1-80ac-2c0dd3dc15af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.084798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-96fc65a7-da55-42a1-80ac-2c0dd3dc15af None None] MFA Rules not processed for user `81d32fd8a341423e91841d2565e66b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:57.090989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-96fc65a7-da55-42a1-80ac-2c0dd3dc15af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:57.126467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb02d5-9ee2-49f2-af67-f0faef501d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:57.127429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb02d5-9ee2-49f2-af67-f0faef501d08 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.127783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb02d5-9ee2-49f2-af67-f0faef501d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.128137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb02d5-9ee2-49f2-af67-f0faef501d08 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.129597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb02d5-9ee2-49f2-af67-f0faef501d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:57.131603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb02d5-9ee2-49f2-af67-f0faef501d08 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.186169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1020/2028] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:57.187357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc65a7-da55-42a1-80ac-2c0dd3dc15af None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.204466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc65a7-da55-42a1-80ac-2c0dd3dc15af None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:57.207955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c845f7-130d-439e-b1b1-f08803f94e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:57.208740 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c845f7-130d-439e-b1b1-f08803f94e26 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.209183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c845f7-130d-439e-b1b1-f08803f94e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.209549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c845f7-130d-439e-b1b1-f08803f94e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.211343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c845f7-130d-439e-b1b1-f08803f94e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:57.213726 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c845f7-130d-439e-b1b1-f08803f94e26 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.269070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1009/2029] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:56 2022] POST /identity/v3/users => generated 288 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:57.274096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb02d5-9ee2-49f2-af67-f0faef501d08 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.292259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb02d5-9ee2-49f2-af67-f0faef501d08 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:57.297773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950b479-c402-4f22-ac21-b06699e93158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:57.302300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950b479-c402-4f22-ac21-b06699e93158 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.302300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950b479-c402-4f22-ac21-b06699e93158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.302300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950b479-c402-4f22-ac21-b06699e93158 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.302300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950b479-c402-4f22-ac21-b06699e93158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:57.302906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950b479-c402-4f22-ac21-b06699e93158 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.321285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1010/2030] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:04:57.322271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950b479-c402-4f22-ac21-b06699e93158 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.338522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950b479-c402-4f22-ac21-b06699e93158 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:57.346943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc662f-a7f7-4932-b62b-8ad6395c6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:57.348255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc662f-a7f7-4932-b62b-8ad6395c6018 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.348600 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc662f-a7f7-4932-b62b-8ad6395c6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.348888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc662f-a7f7-4932-b62b-8ad6395c6018 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.349910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc662f-a7f7-4932-b62b-8ad6395c6018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:57.352331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc662f-a7f7-4932-b62b-8ad6395c6018 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.367463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1011/2031] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:57.372093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc662f-a7f7-4932-b62b-8ad6395c6018 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.389499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1021/2032] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:04:57 2022] POST /identity/v3/projects => generated 357 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:04:57.394174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c845f7-130d-439e-b1b1-f08803f94e26 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.396975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc662f-a7f7-4932-b62b-8ad6395c6018 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:57.494540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c845f7-130d-439e-b1b1-f08803f94e26 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:57.494865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cafdb-1b0c-41ae-b96e-e7bb8c284332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:57.496274 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cafdb-1b0c-41ae-b96e-e7bb8c284332 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.496695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cafdb-1b0c-41ae-b96e-e7bb8c284332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.497044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cafdb-1b0c-41ae-b96e-e7bb8c284332 admin admin] PATH_INFO: `/v3/projects/5bb0853cadbc43b595f2c26fdb1daa06/users/29d0277c79194f6db186cfb205586b54/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.506374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31d09-0665-4544-9c2d-fcec7bae9eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:57.507172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31d09-0665-4544-9c2d-fcec7bae9eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.507533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31d09-0665-4544-9c2d-fcec7bae9eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.507883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31d09-0665-4544-9c2d-fcec7bae9eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.508612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c31d09-0665-4544-9c2d-fcec7bae9eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:57.511223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c31d09-0665-4544-9c2d-fcec7bae9eb2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.532371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cafdb-1b0c-41ae-b96e-e7bb8c284332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb0853cadbc43b595f2c26fdb1daa06, user_id=29d0277c79194f6db186cfb205586b54, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:57.539518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cafdb-1b0c-41ae-b96e-e7bb8c284332 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.615546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1022/2033] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:04:57 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:04:57.620082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9b99-0260-41f5-bb06-cc6b36da9849 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.620386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9b99-0260-41f5-bb06-cc6b36da9849 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.620668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9b99-0260-41f5-bb06-cc6b36da9849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.644964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1012/2034] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:57 2022] PUT /identity/v3/projects/5bb0853cadbc43b595f2c26fdb1daa06/users/29d0277c79194f6db186cfb205586b54/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:57.646606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cafdb-1b0c-41ae-b96e-e7bb8c284332 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.659291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-82de9b99-0260-41f5-bb06-cc6b36da9849 None None] MFA Rules not processed for user `5987014231084f679a795a88f14ad02e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:57.660728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-82de9b99-0260-41f5-bb06-cc6b36da9849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:57.733747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cafdb-1b0c-41ae-b96e-e7bb8c284332 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:57.742205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09ad13-71f6-410c-b6a1-82b3ad23bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:57.743021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ad13-71f6-410c-b6a1-82b3ad23bac2 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.743380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ad13-71f6-410c-b6a1-82b3ad23bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.743732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ad13-71f6-410c-b6a1-82b3ad23bac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.744555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09ad13-71f6-410c-b6a1-82b3ad23bac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:57.747464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09ad13-71f6-410c-b6a1-82b3ad23bac2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.768058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1023/2035] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:57.770725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1013/2036] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:57.771313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4346-dec6-4224-8acb-8845b64e7fdb None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.771771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4346-dec6-4224-8acb-8845b64e7fdb None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.772207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4346-dec6-4224-8acb-8845b64e7fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.775166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09ad13-71f6-410c-b6a1-82b3ad23bac2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.792353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09ad13-71f6-410c-b6a1-82b3ad23bac2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:57.798672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:57.805821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:57.805821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:57.805821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] PATH_INFO: `/v3/projects/ecdf8901ac9c4cd488025dd75fbac93d/users/b952940636ba4ae4ac275fbafafc100f/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:57.822672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdf8901ac9c4cd488025dd75fbac93d, user_id=b952940636ba4ae4ac275fbafafc100f, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:57.826364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:57.836805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-736d4346-dec6-4224-8acb-8845b64e7fdb None None] MFA Rules not processed for user `29d0277c79194f6db186cfb205586b54`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:57.838983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-736d4346-dec6-4224-8acb-8845b64e7fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:57.906946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1014/2037] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:57 2022] PUT /identity/v3/projects/ecdf8901ac9c4cd488025dd75fbac93d/users/b952940636ba4ae4ac275fbafafc100f/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:57.911011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.913987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:57.956012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1024/2038] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:57.956848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4346-dec6-4224-8acb-8845b64e7fdb None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:57.974615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4346-dec6-4224-8acb-8845b64e7fdb None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:58.021889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b2739-a33e-4f42-89b7-5ff64ae72f87 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:58.028543 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9038eb1-1dc4-43db-9a60-ac24e78fa0a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:58.029739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9038eb1-1dc4-43db-9a60-ac24e78fa0a0 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:58.030449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9038eb1-1dc4-43db-9a60-ac24e78fa0a0 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:58.030449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9038eb1-1dc4-43db-9a60-ac24e78fa0a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:58.039513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:58.040136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:58.040420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:58.040693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:58.042172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:58.044678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:58.057109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1025/2039] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:04:58.062046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:58.063991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:58.109338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9038eb1-1dc4-43db-9a60-ac24e78fa0a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:58.112022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9038eb1-1dc4-43db-9a60-ac24e78fa0a0 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:58.124985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1015/2040] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:58.126718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9038eb1-1dc4-43db-9a60-ac24e78fa0a0 service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:58.142836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9038eb1-1dc4-43db-9a60-ac24e78fa0a0 service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:58.148282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bdb4-cd3f-4d5d-b4d6-c5d04369fd82 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:58.152841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:58.153632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:58.157786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:58.157994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b91fc-9f0c-4163-b5b0-20b8d5a50cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:58.158111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:58.158187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b91fc-9f0c-4163-b5b0-20b8d5a50cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:58.158187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b91fc-9f0c-4163-b5b0-20b8d5a50cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:58.158187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b91fc-9f0c-4163-b5b0-20b8d5a50cfd admin admin] PATH_INFO: `/v3/projects/ecdf8901ac9c4cd488025dd75fbac93d/users/b952940636ba4ae4ac275fbafafc100f/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:58.160696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b91fc-9f0c-4163-b5b0-20b8d5a50cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdf8901ac9c4cd488025dd75fbac93d, user_id=b952940636ba4ae4ac275fbafafc100f, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:58.166278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b91fc-9f0c-4163-b5b0-20b8d5a50cfd admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:58.187539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1016/2041] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:04:58 2022] PUT /identity/v3/projects/ecdf8901ac9c4cd488025dd75fbac93d/users/b952940636ba4ae4ac275fbafafc100f/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:58.197847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fadb61-ce04-4fb0-882f-c7b1cd1e0738 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:58.198264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fadb61-ce04-4fb0-882f-c7b1cd1e0738 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:58.198412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fadb61-ce04-4fb0-882f-c7b1cd1e0738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:58.223921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:58.229439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-89fadb61-ce04-4fb0-882f-c7b1cd1e0738 None None] MFA Rules not processed for user `b952940636ba4ae4ac275fbafafc100f`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:58.229705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:58.229785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-89fadb61-ce04-4fb0-882f-c7b1cd1e0738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:58.253572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1026/2042] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:58.336409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1017/2043] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:58 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:58.716056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:58.718741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:58.729140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bc9bc-5024-4cc6-b3cb-8393f346665c service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:58.816982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88798fe8-62de-4417-8e01-a2b28c430f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:58.817756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88798fe8-62de-4417-8e01-a2b28c430f8a service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:58.818042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88798fe8-62de-4417-8e01-a2b28c430f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:58.820530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88798fe8-62de-4417-8e01-a2b28c430f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:58.837933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88798fe8-62de-4417-8e01-a2b28c430f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:58.839725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88798fe8-62de-4417-8e01-a2b28c430f8a service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:58.852557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1027/2044] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:59.059146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fadb61-ce04-4fb0-882f-c7b1cd1e0738 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:59.064565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-89fadb61-ce04-4fb0-882f-c7b1cd1e0738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:59.196393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fadb61-ce04-4fb0-882f-c7b1cd1e0738 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:59.202613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:59.203518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:59.203804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:59.204091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] PATH_INFO: `/v3/users/1ff6ffea0aa94dafa8ae321bbc19460e` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:59.205469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff6ffea0aa94dafa8ae321bbc19460e)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:59.208177 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:59.376675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88798fe8-62de-4417-8e01-a2b28c430f8a service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:59.388261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88798fe8-62de-4417-8e01-a2b28c430f8a service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:59.393293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46022-aa5e-41cb-bf54-8488a40770f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:59.394142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46022-aa5e-41cb-bf54-8488a40770f7 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:59.394532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46022-aa5e-41cb-bf54-8488a40770f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:59.394937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46022-aa5e-41cb-bf54-8488a40770f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:59.459093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee46022-aa5e-41cb-bf54-8488a40770f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:59.460714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee46022-aa5e-41cb-bf54-8488a40770f7 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:59.470171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1028/2045] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:59 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:59.516252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff6ffea0aa94dafa8ae321bbc19460e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:59.528722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff6ffea0aa94dafa8ae321bbc19460e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:59.529475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff6ffea0aa94dafa8ae321bbc19460e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:59.530086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff6ffea0aa94dafa8ae321bbc19460e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:59.650471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff6ffea0aa94dafa8ae321bbc19460e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:59.673053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1018/2046] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:04:59 2022] DELETE /identity/v3/users/1ff6ffea0aa94dafa8ae321bbc19460e => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:04:59.679975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6a94-d9f8-4fee-ba5a-19f3addbe65e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:59.680276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6a94-d9f8-4fee-ba5a-19f3addbe65e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:59.680556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d6a94-d9f8-4fee-ba5a-19f3addbe65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:59.735878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1d7d6a94-d9f8-4fee-ba5a-19f3addbe65e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:59.738480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1d7d6a94-d9f8-4fee-ba5a-19f3addbe65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:59.864596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1029/2047] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:04:59.875633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:59.886133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:59.978382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cc5c6-0555-4851-89dc-559d5f86b981 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:59.983045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:59.983715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:59.984135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:59.984294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:59.997456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:59.997456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:00.007187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1019/2048] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:00.515554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366297-5464-4b97-ab2e-28f262b03549 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:00.517746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366297-5464-4b97-ab2e-28f262b03549 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:00.517746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52366297-5464-4b97-ab2e-28f262b03549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:00.570485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-52366297-5464-4b97-ab2e-28f262b03549 None None] MFA Rules not processed for user `29d0277c79194f6db186cfb205586b54`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:00.572932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-52366297-5464-4b97-ab2e-28f262b03549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:00.688827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:00.691771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:00.727185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1030/2049] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:00.775424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e98e2-9b82-42d8-8374-236ff1cd34a1 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:00.784653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:00.785649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:00.789637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:00.790263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] PATH_INFO: `/v3/projects/bb13d0526b844795b7cab18a1911603b` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:00.791828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb13d0526b844795b7cab18a1911603b)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:00.797634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:00.978238 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb13d0526b844795b7cab18a1911603b', 'request_id': 'req-1df21d6b-f411-4b97-98cc-267c16053f05'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:01.126306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb13d0526b844795b7cab18a1911603b', 'request_id': 'req-1df21d6b-f411-4b97-98cc-267c16053f05'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:01.141085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb13d0526b844795b7cab18a1911603b', 'request_id': 'req-1df21d6b-f411-4b97-98cc-267c16053f05'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:01.191796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] The token cache is being invalidate because project bb13d0526b844795b7cab18a1911603b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:01.192788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:01.200808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1df21d6b-f411-4b97-98cc-267c16053f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:01.203197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1020/2050] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:00 2022] DELETE /identity/v3/projects/bb13d0526b844795b7cab18a1911603b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:01.210235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397abc-a56b-4223-b65c-fd08c219b244 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:01.210737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397abc-a56b-4223-b65c-fd08c219b244 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:01.210812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71397abc-a56b-4223-b65c-fd08c219b244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:01.289529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-71397abc-a56b-4223-b65c-fd08c219b244 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:01.291087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-71397abc-a56b-4223-b65c-fd08c219b244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:01.376761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1031/2051] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:01.385436 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa4a9f-de77-47cc-83d7-6b74adc4b9ad None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:01.385981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa4a9f-de77-47cc-83d7-6b74adc4b9ad None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:01.390560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa4a9f-de77-47cc-83d7-6b74adc4b9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:01.410737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-05aa4a9f-de77-47cc-83d7-6b74adc4b9ad None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:01.412069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-05aa4a9f-de77-47cc-83d7-6b74adc4b9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:01.422030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1021/2052] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:01.428566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71397abc-a56b-4223-b65c-fd08c219b244 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:01.443016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71397abc-a56b-4223-b65c-fd08c219b244 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:01.445476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:01.446332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:01.446620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:01.446899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:01.447826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:01.448333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:01.450135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:01.464438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1032/2053] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:05:01.472595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa4a9f-de77-47cc-83d7-6b74adc4b9ad None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:01.483687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa4a9f-de77-47cc-83d7-6b74adc4b9ad None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:01.491037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c8a29-9ed7-4790-b8a9-0af9907bd9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:01.492066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8a29-9ed7-4790-b8a9-0af9907bd9ff admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:01.492459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8a29-9ed7-4790-b8a9-0af9907bd9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:01.493384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8a29-9ed7-4790-b8a9-0af9907bd9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:01.494607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c8a29-9ed7-4790-b8a9-0af9907bd9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:01.505805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c8a29-9ed7-4790-b8a9-0af9907bd9ff admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:01.706978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1022/2054] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:01 2022] POST /identity/v3/projects => generated 371 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:01.708782 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:01.723928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ca98-d392-4a67-8bbe-c33dc490fb02 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:01.865878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1e7d6-bbed-4b7a-990a-0726381963e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:01.869942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e7d6-bbed-4b7a-990a-0726381963e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:01.872886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e7d6-bbed-4b7a-990a-0726381963e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:01.873955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e7d6-bbed-4b7a-990a-0726381963e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:01.876419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1e7d6-bbed-4b7a-990a-0726381963e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:01.883929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1e7d6-bbed-4b7a-990a-0726381963e4 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:02.066406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1033/2055] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:01 2022] POST /identity/v3/users => generated 286 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:02.070450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c9c77-96f3-460c-83ca-6f3afd882fa2 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:02.070744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c9c77-96f3-460c-83ca-6f3afd882fa2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:02.071194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c9c77-96f3-460c-83ca-6f3afd882fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:02.072641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1e7d6-bbed-4b7a-990a-0726381963e4 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:02.102571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-816c9c77-96f3-460c-83ca-6f3afd882fa2 None None] MFA Rules not processed for user `5987014231084f679a795a88f14ad02e`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:02.104189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1e7d6-bbed-4b7a-990a-0726381963e4 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:02.108481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-816c9c77-96f3-460c-83ca-6f3afd882fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:02.110682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78739b2-461e-41e4-8b3e-772466969d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:02.111557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78739b2-461e-41e4-8b3e-772466969d3a admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:02.111843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78739b2-461e-41e4-8b3e-772466969d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:02.112127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78739b2-461e-41e4-8b3e-772466969d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:02.112865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78739b2-461e-41e4-8b3e-772466969d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:02.115156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78739b2-461e-41e4-8b3e-772466969d3a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:02.127151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1034/2056] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:02.134407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78739b2-461e-41e4-8b3e-772466969d3a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:02.151162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78739b2-461e-41e4-8b3e-772466969d3a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:02.156999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14774d-816d-48c9-9f90-2431dfb2fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:02.158306 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14774d-816d-48c9-9f90-2431dfb2fead admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:02.158600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14774d-816d-48c9-9f90-2431dfb2fead admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:02.158889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14774d-816d-48c9-9f90-2431dfb2fead admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:02.159648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14774d-816d-48c9-9f90-2431dfb2fead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:02.162964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14774d-816d-48c9-9f90-2431dfb2fead admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:02.182537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1035/2057] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:02.185404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14774d-816d-48c9-9f90-2431dfb2fead admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:02.189729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1023/2058] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:02.205854 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14774d-816d-48c9-9f90-2431dfb2fead admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:02.211486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:02.229763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:02.229763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:02.229763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] PATH_INFO: `/v3/projects/921beff7f33a4c56adcfd8400ecfbaa3/users/22ba71bb95404d0983fe0a8b71223285/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:02.260455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921beff7f33a4c56adcfd8400ecfbaa3, user_id=22ba71bb95404d0983fe0a8b71223285, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:02.275154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:02.536750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1036/2059] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:02 2022] PUT /identity/v3/projects/921beff7f33a4c56adcfd8400ecfbaa3/users/22ba71bb95404d0983fe0a8b71223285/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:02.549337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc396bc-69ef-43ad-bd87-1b234ecc5de0 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:02.549674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc396bc-69ef-43ad-bd87-1b234ecc5de0 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:02.549979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc396bc-69ef-43ad-bd87-1b234ecc5de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:02.581605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1fc396bc-69ef-43ad-bd87-1b234ecc5de0 None None] MFA Rules not processed for user `22ba71bb95404d0983fe0a8b71223285`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:02.586266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1fc396bc-69ef-43ad-bd87-1b234ecc5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:02.671976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1024/2060] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:02.686001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:02.690156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:02.790925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35832c2f-b8e9-4f06-974d-5bd3c17eb9d0 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:02.795011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654edb7-ebea-41de-888d-27a28d76eabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:02.795786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654edb7-ebea-41de-888d-27a28d76eabc service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:02.796067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654edb7-ebea-41de-888d-27a28d76eabc service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:02.796347 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654edb7-ebea-41de-888d-27a28d76eabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:02.806350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654edb7-ebea-41de-888d-27a28d76eabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:02.808568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654edb7-ebea-41de-888d-27a28d76eabc service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:02.831201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1037/2061] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:02.849817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc396bc-69ef-43ad-bd87-1b234ecc5de0 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:02.916655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc396bc-69ef-43ad-bd87-1b234ecc5de0 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:02.921766 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:02.922647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:02.922925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:02.923456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] PATH_INFO: `/v3/users/22ba71bb95404d0983fe0a8b71223285` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:02.924611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ba71bb95404d0983fe0a8b71223285)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:02.926856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:03.186619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ba71bb95404d0983fe0a8b71223285'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:03.202200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ba71bb95404d0983fe0a8b71223285'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:03.203700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ba71bb95404d0983fe0a8b71223285'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:03.204388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ba71bb95404d0983fe0a8b71223285'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:03.288919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ba71bb95404d0983fe0a8b71223285'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:03.307275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1025/2062] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:02 2022] DELETE /identity/v3/users/22ba71bb95404d0983fe0a8b71223285 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:03.310861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f621-262b-4b10-9e04-3d6ba416a756 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:03.311346 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f621-262b-4b10-9e04-3d6ba416a756 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:03.311553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f621-262b-4b10-9e04-3d6ba416a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:03.331615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9bd5f621-262b-4b10-9e04-3d6ba416a756 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:03.332880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9bd5f621-262b-4b10-9e04-3d6ba416a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:03.393949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1038/2063] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:03.405023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:03.406532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:03.486449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4db37-c43a-4d96-a58f-85382a105630 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:03.490202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d2334-c2e2-4caf-a47a-8dd398d7223c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:03.490841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2334-c2e2-4caf-a47a-8dd398d7223c service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:03.491120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2334-c2e2-4caf-a47a-8dd398d7223c service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:03.491390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2334-c2e2-4caf-a47a-8dd398d7223c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:03.502473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d2334-c2e2-4caf-a47a-8dd398d7223c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:03.505668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d2334-c2e2-4caf-a47a-8dd398d7223c service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:03.514587 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1026/2064] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:05:04.012477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5f621-262b-4b10-9e04-3d6ba416a756 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:04.012477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9bd5f621-262b-4b10-9e04-3d6ba416a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:04.024457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5f621-262b-4b10-9e04-3d6ba416a756 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:04.030840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:04.031797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.032084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.032365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] PATH_INFO: `/v3/projects/921beff7f33a4c56adcfd8400ecfbaa3` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.033617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921beff7f33a4c56adcfd8400ecfbaa3)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:04.035576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:04.172005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921beff7f33a4c56adcfd8400ecfbaa3', 'request_id': 'req-51d5474a-792c-421b-a1ab-269fa304c334'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:04.248840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921beff7f33a4c56adcfd8400ecfbaa3', 'request_id': 'req-51d5474a-792c-421b-a1ab-269fa304c334'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:04.255032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921beff7f33a4c56adcfd8400ecfbaa3', 'request_id': 'req-51d5474a-792c-421b-a1ab-269fa304c334'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:04.266898 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] The token cache is being invalidate because project 921beff7f33a4c56adcfd8400ecfbaa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:04.267162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:04.267795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-51d5474a-792c-421b-a1ab-269fa304c334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:04.269352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1039/2065] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:04 2022] DELETE /identity/v3/projects/921beff7f33a4c56adcfd8400ecfbaa3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:04.275830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d168a7-36a7-4c13-8a0e-30395c6e36ba None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.276328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d168a7-36a7-4c13-8a0e-30395c6e36ba None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.276328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d168a7-36a7-4c13-8a0e-30395c6e36ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.296971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-68d168a7-36a7-4c13-8a0e-30395c6e36ba None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:04.298405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-68d168a7-36a7-4c13-8a0e-30395c6e36ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:04.368726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1027/2066] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:04.376931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804fae-8b69-4557-ae77-d657b5a0e51a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.377447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804fae-8b69-4557-ae77-d657b5a0e51a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.377553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804fae-8b69-4557-ae77-d657b5a0e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.399582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a4804fae-8b69-4557-ae77-d657b5a0e51a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:04.400819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a4804fae-8b69-4557-ae77-d657b5a0e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:04.410631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1040/2067] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:04.415256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d168a7-36a7-4c13-8a0e-30395c6e36ba None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:04.425763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d168a7-36a7-4c13-8a0e-30395c6e36ba None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:04.430329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:04.430996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.431279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.431556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.432325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:04.432635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:04.434963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:04.447137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1028/2068] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:05:04.452911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4804fae-8b69-4557-ae77-d657b5a0e51a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:04.462266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4804fae-8b69-4557-ae77-d657b5a0e51a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:04.468175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e42cc9-f3de-44da-9e60-3da891cf6b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:04.468828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e42cc9-f3de-44da-9e60-3da891cf6b8e admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.469115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e42cc9-f3de-44da-9e60-3da891cf6b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.469429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e42cc9-f3de-44da-9e60-3da891cf6b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.470122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e42cc9-f3de-44da-9e60-3da891cf6b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:04.472017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e42cc9-f3de-44da-9e60-3da891cf6b8e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:04.582638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1041/2069] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:04 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:04.586695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:04.598146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365d8c-41d4-4880-b8ac-bed0d6178c85 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:04.654053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af123a8-89e3-4829-a9aa-d0c1e58cb990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:04.654726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af123a8-89e3-4829-a9aa-d0c1e58cb990 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.655010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af123a8-89e3-4829-a9aa-d0c1e58cb990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.655283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af123a8-89e3-4829-a9aa-d0c1e58cb990 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.656013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af123a8-89e3-4829-a9aa-d0c1e58cb990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:04.657991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af123a8-89e3-4829-a9aa-d0c1e58cb990 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:04.762030 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1029/2070] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:04 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:04.763683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e42cc9-f3de-44da-9e60-3da891cf6b8e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:04.774311 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e42cc9-f3de-44da-9e60-3da891cf6b8e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:04.780580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96dfec-1ad6-45d3-bdb5-2f0e859e43ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:04.781281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96dfec-1ad6-45d3-bdb5-2f0e859e43ee admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.781591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96dfec-1ad6-45d3-bdb5-2f0e859e43ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.781856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96dfec-1ad6-45d3-bdb5-2f0e859e43ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.782651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96dfec-1ad6-45d3-bdb5-2f0e859e43ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:04.784425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96dfec-1ad6-45d3-bdb5-2f0e859e43ee admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:04.797505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1042/2071] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:04.801502 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af123a8-89e3-4829-a9aa-d0c1e58cb990 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:04.813082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af123a8-89e3-4829-a9aa-d0c1e58cb990 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:04.818455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21f009-d00e-4536-a68d-a04384664df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:04.819303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21f009-d00e-4536-a68d-a04384664df2 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.819689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21f009-d00e-4536-a68d-a04384664df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.820069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21f009-d00e-4536-a68d-a04384664df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.820933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21f009-d00e-4536-a68d-a04384664df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:04.822708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21f009-d00e-4536-a68d-a04384664df2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:04.838467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1030/2072] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:04.840372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96dfec-1ad6-45d3-bdb5-2f0e859e43ee admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:04.859585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96dfec-1ad6-45d3-bdb5-2f0e859e43ee admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:04.864925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:04.865882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.866310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.866592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] PATH_INFO: `/v3/projects/88a63492d899456b992ad5ab7c8affca/users/7193d40ab98640c399e88bcdc2659de6/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:04.884472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a63492d899456b992ad5ab7c8affca, user_id=7193d40ab98640c399e88bcdc2659de6, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:04.889666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:04.983605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1043/2073] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:04 2022] PUT /identity/v3/projects/88a63492d899456b992ad5ab7c8affca/users/7193d40ab98640c399e88bcdc2659de6/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:04.989674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be47158-e29c-43e8-9cb9-8fbbe503f1a3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:04.990165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be47158-e29c-43e8-9cb9-8fbbe503f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:04.990825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be47158-e29c-43e8-9cb9-8fbbe503f1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:05.012232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6be47158-e29c-43e8-9cb9-8fbbe503f1a3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:05.018310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6be47158-e29c-43e8-9cb9-8fbbe503f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:05.077912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1031/2074] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:05.088841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:05.091054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:05.155094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e1de8-56e8-4684-88ec-1530d2ae1b25 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:05.159035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a60a-f70b-45c4-8768-751cd23fc737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:05.159689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a60a-f70b-45c4-8768-751cd23fc737 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:05.159972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a60a-f70b-45c4-8768-751cd23fc737 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:05.160251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a60a-f70b-45c4-8768-751cd23fc737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:05.171228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a60a-f70b-45c4-8768-751cd23fc737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:05.172721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a60a-f70b-45c4-8768-751cd23fc737 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:05.185475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1044/2075] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:14.092708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa68e-92c7-422e-9be7-e8f721dafbd5 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:14.093973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa68e-92c7-422e-9be7-e8f721dafbd5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:14.096112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa68e-92c7-422e-9be7-e8f721dafbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:14.140390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e5eaa68e-92c7-422e-9be7-e8f721dafbd5 None None] MFA Rules not processed for user `7193d40ab98640c399e88bcdc2659de6`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:14.141859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e5eaa68e-92c7-422e-9be7-e8f721dafbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:14.230780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1032/2076] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:14.235732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a60a-f70b-45c4-8768-751cd23fc737 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:14.267232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a60a-f70b-45c4-8768-751cd23fc737 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:14.279964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659683-e9c5-49cd-816c-2937aaa01c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:14.280858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659683-e9c5-49cd-816c-2937aaa01c07 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:14.281211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659683-e9c5-49cd-816c-2937aaa01c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:14.281757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659683-e9c5-49cd-816c-2937aaa01c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:14.282537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d659683-e9c5-49cd-816c-2937aaa01c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:14.284584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d659683-e9c5-49cd-816c-2937aaa01c07 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:14.468648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1045/2077] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:14 2022] POST /identity/v3/projects => generated 371 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:14.472419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaa68e-92c7-422e-9be7-e8f721dafbd5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:14.492259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaa68e-92c7-422e-9be7-e8f721dafbd5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:14.560563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203090-b3c0-4d90-9fdd-131ab6238011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:14.561293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203090-b3c0-4d90-9fdd-131ab6238011 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:14.561580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203090-b3c0-4d90-9fdd-131ab6238011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:14.561854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203090-b3c0-4d90-9fdd-131ab6238011 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:14.562634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9203090-b3c0-4d90-9fdd-131ab6238011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:14.564837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9203090-b3c0-4d90-9fdd-131ab6238011 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:14.684791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1033/2078] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:14 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:14.688845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659683-e9c5-49cd-816c-2937aaa01c07 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:14.699448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659683-e9c5-49cd-816c-2937aaa01c07 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:14.704466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec8569-5434-4a30-97a1-fe23e2539c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:14.705212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec8569-5434-4a30-97a1-fe23e2539c9a admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:14.705601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec8569-5434-4a30-97a1-fe23e2539c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:14.705956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec8569-5434-4a30-97a1-fe23e2539c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:14.706687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec8569-5434-4a30-97a1-fe23e2539c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:14.708303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec8569-5434-4a30-97a1-fe23e2539c9a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:14.720433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1046/2079] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:14.724589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203090-b3c0-4d90-9fdd-131ab6238011 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:14.736287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203090-b3c0-4d90-9fdd-131ab6238011 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:14.746955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d464ce-ae43-4df8-b664-82afb9fa6f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:14.748181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d464ce-ae43-4df8-b664-82afb9fa6f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:14.748557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d464ce-ae43-4df8-b664-82afb9fa6f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:14.748949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d464ce-ae43-4df8-b664-82afb9fa6f5b admin admin] PATH_INFO: `/v3/projects/f069da9dd6984432a143e118febee213/users/086db52043b6409fbff0d47d7b045b47/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:14.767849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d464ce-ae43-4df8-b664-82afb9fa6f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f069da9dd6984432a143e118febee213, user_id=086db52043b6409fbff0d47d7b045b47, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:14.770816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d464ce-ae43-4df8-b664-82afb9fa6f5b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:14.854141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1034/2080] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:14 2022] PUT /identity/v3/projects/f069da9dd6984432a143e118febee213/users/086db52043b6409fbff0d47d7b045b47/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:14.856159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec8569-5434-4a30-97a1-fe23e2539c9a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:14.870137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec8569-5434-4a30-97a1-fe23e2539c9a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:14.937475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950673e-5ab2-497a-b3e5-fd556b3cfdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:14.938563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950673e-5ab2-497a-b3e5-fd556b3cfdcd admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:14.938842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950673e-5ab2-497a-b3e5-fd556b3cfdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:14.939123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950673e-5ab2-497a-b3e5-fd556b3cfdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:14.939927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950673e-5ab2-497a-b3e5-fd556b3cfdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:14.941684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950673e-5ab2-497a-b3e5-fd556b3cfdcd admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:14.956350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1047/2081] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:14.962739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d464ce-ae43-4df8-b664-82afb9fa6f5b admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:14.974440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d464ce-ae43-4df8-b664-82afb9fa6f5b admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:14.979513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:14.980447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:14.980732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:14.981046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] PATH_INFO: `/v3/projects/f069da9dd6984432a143e118febee213/users/086db52043b6409fbff0d47d7b045b47/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:14.983809 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f069da9dd6984432a143e118febee213, user_id=086db52043b6409fbff0d47d7b045b47, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:14.986621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:15.001299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1035/2082] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:14 2022] PUT /identity/v3/projects/f069da9dd6984432a143e118febee213/users/086db52043b6409fbff0d47d7b045b47/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:23.859714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b97e-6bdb-4311-a480-26dfdd8625d2 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:23.860195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b97e-6bdb-4311-a480-26dfdd8625d2 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:23.860333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81b97e-6bdb-4311-a480-26dfdd8625d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:23.888898 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1f81b97e-6bdb-4311-a480-26dfdd8625d2 None None] MFA Rules not processed for user `086db52043b6409fbff0d47d7b045b47`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:23.890688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1f81b97e-6bdb-4311-a480-26dfdd8625d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:23.984159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1048/2083] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:24.129409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:24.129409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:24.232575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e02a1-54d8-4631-a398-59a1752e64b2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:24.239309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34186-1271-4b00-8700-3f7c2ff9ba44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:24.239996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34186-1271-4b00-8700-3f7c2ff9ba44 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:24.240329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34186-1271-4b00-8700-3f7c2ff9ba44 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:24.241330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34186-1271-4b00-8700-3f7c2ff9ba44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:24.331693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e34186-1271-4b00-8700-3f7c2ff9ba44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:24.333459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e34186-1271-4b00-8700-3f7c2ff9ba44 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:24.345328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1036/2084] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:24.798421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81b97e-6bdb-4311-a480-26dfdd8625d2 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:24.800444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1f81b97e-6bdb-4311-a480-26dfdd8625d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:24.893141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81b97e-6bdb-4311-a480-26dfdd8625d2 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:24.899357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:24.900254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:24.900527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:24.901019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] PATH_INFO: `/v3/users/81d32fd8a341423e91841d2565e66b7d` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:24.903232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d32fd8a341423e91841d2565e66b7d)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:24.905912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:25.304077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d32fd8a341423e91841d2565e66b7d'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:25.322277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d32fd8a341423e91841d2565e66b7d'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:25.323411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d32fd8a341423e91841d2565e66b7d'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:25.324964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d32fd8a341423e91841d2565e66b7d'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:25.454531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d32fd8a341423e91841d2565e66b7d'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:25.471744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1049/2085] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:24 2022] DELETE /identity/v3/users/81d32fd8a341423e91841d2565e66b7d => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:25.476821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37992d94-334d-470f-9424-69e8d4927963 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:25.477692 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37992d94-334d-470f-9424-69e8d4927963 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:25.477692 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37992d94-334d-470f-9424-69e8d4927963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:25.497154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-37992d94-334d-470f-9424-69e8d4927963 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:25.498422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-37992d94-334d-470f-9424-69e8d4927963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:25.604453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1037/2086] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:25.624876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:25.628198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:25.735869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa303f-38da-463f-a893-4a606be1bba7 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:25.743192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da741f71-9695-4923-ba29-e582c5d80306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:25.744199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da741f71-9695-4923-ba29-e582c5d80306 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:25.744599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da741f71-9695-4923-ba29-e582c5d80306 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:25.745011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da741f71-9695-4923-ba29-e582c5d80306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:25.811080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da741f71-9695-4923-ba29-e582c5d80306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:25.812617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da741f71-9695-4923-ba29-e582c5d80306 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:25.853854 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1050/2087] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:27.945789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37992d94-334d-470f-9424-69e8d4927963 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:27.952079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-37992d94-334d-470f-9424-69e8d4927963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:27.981016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37992d94-334d-470f-9424-69e8d4927963 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:27.992026 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:27.993817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:27.994574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:27.995324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] PATH_INFO: `/v3/projects/c691fe96a79b49b39d56078c11085e2d` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:27.999634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c691fe96a79b49b39d56078c11085e2d)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:28.010206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:28.301610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c691fe96a79b49b39d56078c11085e2d', 'request_id': 'req-a37c658c-1d11-4c24-a6f2-69d68c5909bd'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:28.517354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c691fe96a79b49b39d56078c11085e2d', 'request_id': 'req-a37c658c-1d11-4c24-a6f2-69d68c5909bd'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:28.524737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c691fe96a79b49b39d56078c11085e2d', 'request_id': 'req-a37c658c-1d11-4c24-a6f2-69d68c5909bd'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:28.541081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] The token cache is being invalidate because project c691fe96a79b49b39d56078c11085e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:28.541416 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:28.543396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:28.546172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1038/2088] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:27 2022] DELETE /identity/v3/projects/c691fe96a79b49b39d56078c11085e2d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:28.550580 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da741f71-9695-4923-ba29-e582c5d80306 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:28.563103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da741f71-9695-4923-ba29-e582c5d80306 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:28.630766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:28.631644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:28.632057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:28.632332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] PATH_INFO: `/v3/users/b952940636ba4ae4ac275fbafafc100f` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:28.633692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b952940636ba4ae4ac275fbafafc100f)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:28.635730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:29.107361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b952940636ba4ae4ac275fbafafc100f'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:29.120432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b952940636ba4ae4ac275fbafafc100f'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:29.121320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b952940636ba4ae4ac275fbafafc100f'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:29.121949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b952940636ba4ae4ac275fbafafc100f'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:29.294433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0191d60d-19bb-4951-ac1d-6577903c8219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b952940636ba4ae4ac275fbafafc100f'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:29.308910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1051/2089] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:28 2022] DELETE /identity/v3/users/b952940636ba4ae4ac275fbafafc100f => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:29.919063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:29.921159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:29.948326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c658c-1d11-4c24-a6f2-69d68c5909bd admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:30.038533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:30.039620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.040558 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.041105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] PATH_INFO: `/v3/projects/ecdf8901ac9c4cd488025dd75fbac93d` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.043023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecdf8901ac9c4cd488025dd75fbac93d)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:30.044994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:30.176940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecdf8901ac9c4cd488025dd75fbac93d', 'request_id': 'req-a1f95165-9b22-43fc-996b-9a366409eb60'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:30.288732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecdf8901ac9c4cd488025dd75fbac93d', 'request_id': 'req-a1f95165-9b22-43fc-996b-9a366409eb60'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:30.297690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecdf8901ac9c4cd488025dd75fbac93d', 'request_id': 'req-a1f95165-9b22-43fc-996b-9a366409eb60'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:30.310765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] The token cache is being invalidate because project ecdf8901ac9c4cd488025dd75fbac93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:30.311061 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:30.311941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a1f95165-9b22-43fc-996b-9a366409eb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:30.323009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c079c-992a-4e23-93de-48e3be4d0460 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.324295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c079c-992a-4e23-93de-48e3be4d0460 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.324496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c079c-992a-4e23-93de-48e3be4d0460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.326114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1039/2090] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:29 2022] DELETE /identity/v3/projects/ecdf8901ac9c4cd488025dd75fbac93d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:30.370102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f74c079c-992a-4e23-93de-48e3be4d0460 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:30.371940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f74c079c-992a-4e23-93de-48e3be4d0460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:30.439556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1052/2091] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:30.451926 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabbc4a-1f13-43e6-9d76-973afe97b21f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.452753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabbc4a-1f13-43e6-9d76-973afe97b21f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.453127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabbc4a-1f13-43e6-9d76-973afe97b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.473128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-bbabbc4a-1f13-43e6-9d76-973afe97b21f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:30.474411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bbabbc4a-1f13-43e6-9d76-973afe97b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:30.482713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1040/2092] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:30.487089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c079c-992a-4e23-93de-48e3be4d0460 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:30.497316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c079c-992a-4e23-93de-48e3be4d0460 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:30.502237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d570856-bc94-4b1d-8aef-35a03adff9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:30.502884 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d570856-bc94-4b1d-8aef-35a03adff9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.503167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d570856-bc94-4b1d-8aef-35a03adff9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.503447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d570856-bc94-4b1d-8aef-35a03adff9f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.504164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d570856-bc94-4b1d-8aef-35a03adff9f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:30.504469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d570856-bc94-4b1d-8aef-35a03adff9f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:30.506199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d570856-bc94-4b1d-8aef-35a03adff9f0 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:30.518878 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1053/2093] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:05:30.523655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabbc4a-1f13-43e6-9d76-973afe97b21f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:30.533188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabbc4a-1f13-43e6-9d76-973afe97b21f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:30.538044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22591fb-7ffa-40fa-9535-0dc832bbc28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:30.538701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22591fb-7ffa-40fa-9535-0dc832bbc28e admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.538982 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22591fb-7ffa-40fa-9535-0dc832bbc28e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.539261 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22591fb-7ffa-40fa-9535-0dc832bbc28e admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.539951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22591fb-7ffa-40fa-9535-0dc832bbc28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:30.542765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22591fb-7ffa-40fa-9535-0dc832bbc28e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:30.553814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0892-ea1f-4f3b-86f2-ae36f3aa880b None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.554343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0892-ea1f-4f3b-86f2-ae36f3aa880b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.554626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0892-ea1f-4f3b-86f2-ae36f3aa880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.575009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ba6d0892-ea1f-4f3b-86f2-ae36f3aa880b None None] MFA Rules not processed for user `7193d40ab98640c399e88bcdc2659de6`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:30.576290 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ba6d0892-ea1f-4f3b-86f2-ae36f3aa880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:30.632414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1054/2094] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:30.657497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1041/2095] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:30 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:30.666521 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0892-ea1f-4f3b-86f2-ae36f3aa880b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:30.678387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0892-ea1f-4f3b-86f2-ae36f3aa880b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:30.743302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879610-a8b8-4a50-b60f-6fb4408a7c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:30.743524 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879610-a8b8-4a50-b60f-6fb4408a7c1b admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.743972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879610-a8b8-4a50-b60f-6fb4408a7c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.744408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879610-a8b8-4a50-b60f-6fb4408a7c1b admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.745309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6879610-a8b8-4a50-b60f-6fb4408a7c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:30.748015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6879610-a8b8-4a50-b60f-6fb4408a7c1b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:30.862453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1055/2096] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:30 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:30.867101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22591fb-7ffa-40fa-9535-0dc832bbc28e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:30.878261 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22591fb-7ffa-40fa-9535-0dc832bbc28e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:30.883240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f720da-8696-40c9-8421-35d34e4336f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:30.883920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f720da-8696-40c9-8421-35d34e4336f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.884275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f720da-8696-40c9-8421-35d34e4336f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.884621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f720da-8696-40c9-8421-35d34e4336f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.885396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f720da-8696-40c9-8421-35d34e4336f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:30.887897 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f720da-8696-40c9-8421-35d34e4336f0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:30.901091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1042/2097] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:30.905508 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879610-a8b8-4a50-b60f-6fb4408a7c1b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:30.918121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879610-a8b8-4a50-b60f-6fb4408a7c1b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:30.924477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89878fd-0321-40c2-9943-8869e2dbafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:30.925355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89878fd-0321-40c2-9943-8869e2dbafff admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.925676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89878fd-0321-40c2-9943-8869e2dbafff admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.925911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89878fd-0321-40c2-9943-8869e2dbafff admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.927429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89878fd-0321-40c2-9943-8869e2dbafff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:30.929042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89878fd-0321-40c2-9943-8869e2dbafff admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:30.940856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1056/2098] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:05:30.947999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f720da-8696-40c9-8421-35d34e4336f0 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:30.959151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f720da-8696-40c9-8421-35d34e4336f0 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:30.965131 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24a678-65a6-4759-9899-cd7580e5d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:30.966059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a678-65a6-4759-9899-cd7580e5d978 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:30.966560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a678-65a6-4759-9899-cd7580e5d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:30.966844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a678-65a6-4759-9899-cd7580e5d978 admin admin] PATH_INFO: `/v3/projects/658de429be9b455797ab694c85cd02e9/users/5213573971014023a197544ef047431e/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:30.983075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24a678-65a6-4759-9899-cd7580e5d978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658de429be9b455797ab694c85cd02e9, user_id=5213573971014023a197544ef047431e, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:30.985957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24a678-65a6-4759-9899-cd7580e5d978 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:31.044006 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1043/2099] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:30 2022] PUT /identity/v3/projects/658de429be9b455797ab694c85cd02e9/users/5213573971014023a197544ef047431e/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:31.054417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4b11-29e9-45f6-ab2b-4a29ffda5e30 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.054707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4b11-29e9-45f6-ab2b-4a29ffda5e30 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.055008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4b11-29e9-45f6-ab2b-4a29ffda5e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.081762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-466d4b11-29e9-45f6-ab2b-4a29ffda5e30 None None] MFA Rules not processed for user `5213573971014023a197544ef047431e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:31.082977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-466d4b11-29e9-45f6-ab2b-4a29ffda5e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:31.152592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1057/2100] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:31.157187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24a678-65a6-4759-9899-cd7580e5d978 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:31.231446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24a678-65a6-4759-9899-cd7580e5d978 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:31.236580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba98e4-4f38-4253-8628-82c9e2627436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:31.237273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba98e4-4f38-4253-8628-82c9e2627436 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.237563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba98e4-4f38-4253-8628-82c9e2627436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.237841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba98e4-4f38-4253-8628-82c9e2627436 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.238559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba98e4-4f38-4253-8628-82c9e2627436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:31.240478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba98e4-4f38-4253-8628-82c9e2627436 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:31.439295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1044/2101] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:31 2022] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:31.443517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4b11-29e9-45f6-ab2b-4a29ffda5e30 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:31.454366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4b11-29e9-45f6-ab2b-4a29ffda5e30 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:31.512055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f56bc-7ab8-4ab8-9fd0-12fe6ddc029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:31.512706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f56bc-7ab8-4ab8-9fd0-12fe6ddc029d admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.512989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f56bc-7ab8-4ab8-9fd0-12fe6ddc029d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.513297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f56bc-7ab8-4ab8-9fd0-12fe6ddc029d admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.514039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f56bc-7ab8-4ab8-9fd0-12fe6ddc029d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:31.516060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f56bc-7ab8-4ab8-9fd0-12fe6ddc029d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:31.598822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4deb-8a3a-4603-ba8b-47a4f2d85a8a None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.599113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4deb-8a3a-4603-ba8b-47a4f2d85a8a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.599387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb4deb-8a3a-4603-ba8b-47a4f2d85a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.630495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-2bbb4deb-8a3a-4603-ba8b-47a4f2d85a8a None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:31.631725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2bbb4deb-8a3a-4603-ba8b-47a4f2d85a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:31.691196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1058/2102] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:31 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:31.694214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f56bc-7ab8-4ab8-9fd0-12fe6ddc029d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:31.705898 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f56bc-7ab8-4ab8-9fd0-12fe6ddc029d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:31.710299 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1045/2103] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:05:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:31.717085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:31.718113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.718443 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.719252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.719663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:31.721449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:31.732915 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1059/2104] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:05:31.737401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4deb-8a3a-4603-ba8b-47a4f2d85a8a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:31.749962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb4deb-8a3a-4603-ba8b-47a4f2d85a8a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:31.755398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e1195-639b-4a1c-9f57-fcca03ceeb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:31.756433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e1195-639b-4a1c-9f57-fcca03ceeb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.756726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e1195-639b-4a1c-9f57-fcca03ceeb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.757053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e1195-639b-4a1c-9f57-fcca03ceeb01 admin admin] PATH_INFO: `/v3/projects/ee528fa7187940fb9cb28bd60fefb458/users/bca3950b04704cf39326328143652b23/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.758315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:31.760566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:31.776394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e1195-639b-4a1c-9f57-fcca03ceeb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee528fa7187940fb9cb28bd60fefb458, user_id=bca3950b04704cf39326328143652b23, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:31.779361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e1195-639b-4a1c-9f57-fcca03ceeb01 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:31.836479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4a3a6-81cd-444a-9f84-bfbbb3d0907b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:31.842957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218b97-2df2-4476-9c37-e657bf7ddec2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:31.845746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218b97-2df2-4476-9c37-e657bf7ddec2 service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.845746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218b97-2df2-4476-9c37-e657bf7ddec2 service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.845746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37218b97-2df2-4476-9c37-e657bf7ddec2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.852877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218b97-2df2-4476-9c37-e657bf7ddec2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:31.854577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37218b97-2df2-4476-9c37-e657bf7ddec2 service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:31.863260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1060/2105] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:05:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:05:31.872716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1046/2106] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:31 2022] PUT /identity/v3/projects/ee528fa7187940fb9cb28bd60fefb458/users/bca3950b04704cf39326328143652b23/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:31.877616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218b97-2df2-4476-9c37-e657bf7ddec2 service swift] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:31.888670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37218b97-2df2-4476-9c37-e657bf7ddec2 service swift] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:31.947681 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518645ae-8edf-42ef-b888-a1ade658549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:31.948268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518645ae-8edf-42ef-b888-a1ade658549d admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.949118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518645ae-8edf-42ef-b888-a1ade658549d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.949918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518645ae-8edf-42ef-b888-a1ade658549d admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.950663 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518645ae-8edf-42ef-b888-a1ade658549d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:31.952272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518645ae-8edf-42ef-b888-a1ade658549d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:31.967576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e1195-639b-4a1c-9f57-fcca03ceeb01 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:31.969321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1061/2107] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:31.978540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e1195-639b-4a1c-9f57-fcca03ceeb01 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:31.983947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:31.984869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:31.985178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:31.985455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] PATH_INFO: `/v3/projects/ee528fa7187940fb9cb28bd60fefb458/users/bca3950b04704cf39326328143652b23/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:31.987567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee528fa7187940fb9cb28bd60fefb458, user_id=bca3950b04704cf39326328143652b23, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:31.990258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:32.002413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1047/2108] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:31 2022] PUT /identity/v3/projects/ee528fa7187940fb9cb28bd60fefb458/users/bca3950b04704cf39326328143652b23/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:32.014523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a501-12d5-4b18-b0c3-bbb9d287270e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:32.014857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a501-12d5-4b18-b0c3-bbb9d287270e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:32.015167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a501-12d5-4b18-b0c3-bbb9d287270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:32.046131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0708a501-12d5-4b18-b0c3-bbb9d287270e None None] MFA Rules not processed for user `bca3950b04704cf39326328143652b23`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:32.047399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0708a501-12d5-4b18-b0c3-bbb9d287270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:32.124846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1062/2109] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:32.137609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:32.139451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:32.199372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537dd4b-0c81-40a0-b164-0dddb879a553 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:32.202894 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949e511-4c17-4e52-854f-7f7056de0bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:32.203545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949e511-4c17-4e52-854f-7f7056de0bff service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:32.203830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949e511-4c17-4e52-854f-7f7056de0bff service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:32.204130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949e511-4c17-4e52-854f-7f7056de0bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:32.213713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949e511-4c17-4e52-854f-7f7056de0bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:32.215698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949e511-4c17-4e52-854f-7f7056de0bff service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:32.225862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1048/2110] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:34.177319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708a501-12d5-4b18-b0c3-bbb9d287270e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:34.187730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708a501-12d5-4b18-b0c3-bbb9d287270e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:34.192456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050524f-f9f7-4792-a08c-af74c7968f07 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca3950b04704cf39326328143652b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee528fa7187940fb9cb28bd60fefb458', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:34.193310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050524f-f9f7-4792-a08c-af74c7968f07 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:34.193618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050524f-f9f7-4792-a08c-af74c7968f07 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:34.193895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050524f-f9f7-4792-a08c-af74c7968f07 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:34.194634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050524f-f9f7-4792-a08c-af74c7968f07 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:34.194946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050524f-f9f7-4792-a08c-af74c7968f07 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:34.196745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050524f-f9f7-4792-a08c-af74c7968f07 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:34.210908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1063/2111] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:05:34.215745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949e511-4c17-4e52-854f-7f7056de0bff service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:34.225481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949e511-4c17-4e52-854f-7f7056de0bff service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:34.230424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588de73-116a-478f-8e16-2b8215863e8a tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca3950b04704cf39326328143652b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee528fa7187940fb9cb28bd60fefb458', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:34.231076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588de73-116a-478f-8e16-2b8215863e8a tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:34.231364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588de73-116a-478f-8e16-2b8215863e8a tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:34.231644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588de73-116a-478f-8e16-2b8215863e8a tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:34.232340 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588de73-116a-478f-8e16-2b8215863e8a tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:34.234337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588de73-116a-478f-8e16-2b8215863e8a tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:34.298532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971a01-69e9-4e5b-b224-50f9cb193b0e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:34.299069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971a01-69e9-4e5b-b224-50f9cb193b0e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:34.303218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45971a01-69e9-4e5b-b224-50f9cb193b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:34.323113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-45971a01-69e9-4e5b-b224-50f9cb193b0e None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:34.324814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-45971a01-69e9-4e5b-b224-50f9cb193b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:34.369987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1049/2112] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:34 2022] POST /identity/v3/projects => generated 353 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:34.375150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588de73-116a-478f-8e16-2b8215863e8a tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:34.396114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1064/2113] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 14:05:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:34.414153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971a01-69e9-4e5b-b224-50f9cb193b0e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:34.463936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588de73-116a-478f-8e16-2b8215863e8a tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:34.478670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca3950b04704cf39326328143652b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee528fa7187940fb9cb28bd60fefb458', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:34.478670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:34.478955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:34.479579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:34.485624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:34.485624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:34.485624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:34.503376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1050/2114] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:05:34.508234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45971a01-69e9-4e5b-b224-50f9cb193b0e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:34.539173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:34.551737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23bb5-1939-4d42-a930-6aa831ce4b82 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:34.559095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca3950b04704cf39326328143652b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee528fa7187940fb9cb28bd60fefb458', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:34.560642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:34.561035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:34.561422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] PATH_INFO: `/v3/projects/d11924def17d4f139e1efb8f4caf4d10` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:34.563059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d11924def17d4f139e1efb8f4caf4d10)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:34.565051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:34.583427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc27a3d-2151-482a-a0e3-e44d816d15b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:34.584234 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc27a3d-2151-482a-a0e3-e44d816d15b2 service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:34.584613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc27a3d-2151-482a-a0e3-e44d816d15b2 service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:34.585006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc27a3d-2151-482a-a0e3-e44d816d15b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:34.644561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc27a3d-2151-482a-a0e3-e44d816d15b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:34.646202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc27a3d-2151-482a-a0e3-e44d816d15b2 service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:34.655485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1065/2115] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:05:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:05:34.689828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11924def17d4f139e1efb8f4caf4d10', 'request_id': 'req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:34.768602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11924def17d4f139e1efb8f4caf4d10', 'request_id': 'req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:34.779867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11924def17d4f139e1efb8f4caf4d10', 'request_id': 'req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:34.794878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] The token cache is being invalidate because project d11924def17d4f139e1efb8f4caf4d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:34.795175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:34.795878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:34.797501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1051/2116] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:34 2022] DELETE /identity/v3/projects/d11924def17d4f139e1efb8f4caf4d10 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:35.514970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666b79-d87a-40be-8a6a-290eef0c0537 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:35.515830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666b79-d87a-40be-8a6a-290eef0c0537 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:35.516107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666b79-d87a-40be-8a6a-290eef0c0537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:35.535826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a2666b79-d87a-40be-8a6a-290eef0c0537 None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:35.537057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a2666b79-d87a-40be-8a6a-290eef0c0537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:35.602537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1066/2117] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:05:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:35.610806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:35.612302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:35.685751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ba8d9-1e2a-457b-94f4-2f5dde51d703 tempest-VolumeQuotaClassesTest-1235493865 tempest-VolumeQuotaClassesTest-1235493865-project-admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:35.692052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c60c8-6aab-4ae9-8f29-ca2cbebbcc91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:35.692052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c60c8-6aab-4ae9-8f29-ca2cbebbcc91 service swift] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:35.692052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c60c8-6aab-4ae9-8f29-ca2cbebbcc91 service swift] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:35.692464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c60c8-6aab-4ae9-8f29-ca2cbebbcc91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:35.702212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c60c8-6aab-4ae9-8f29-ca2cbebbcc91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:35.703963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c60c8-6aab-4ae9-8f29-ca2cbebbcc91 service swift] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:35.713066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1052/2118] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:05:35.715353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2666b79-d87a-40be-8a6a-290eef0c0537 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:35.716902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a2666b79-d87a-40be-8a6a-290eef0c0537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:35.806367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2666b79-d87a-40be-8a6a-290eef0c0537 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:35.812172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:35.816757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:35.816757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:35.816757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] PATH_INFO: `/v3/users/5213573971014023a197544ef047431e` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:35.816757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5213573971014023a197544ef047431e)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:35.817607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:36.045693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5213573971014023a197544ef047431e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:36.058908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5213573971014023a197544ef047431e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:36.059800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5213573971014023a197544ef047431e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:36.060463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5213573971014023a197544ef047431e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:36.156649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5213573971014023a197544ef047431e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:36.172967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1067/2119] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:35 2022] DELETE /identity/v3/users/5213573971014023a197544ef047431e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:36.177759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739338e-563c-4fce-bf76-b33520d6bb5e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:36.186187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739338e-563c-4fce-bf76-b33520d6bb5e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:36.186187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739338e-563c-4fce-bf76-b33520d6bb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:36.210202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-7739338e-563c-4fce-bf76-b33520d6bb5e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:36.211499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7739338e-563c-4fce-bf76-b33520d6bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:36.285755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1053/2120] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:36.299468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:36.302646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:36.391327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ae47-16fa-499c-a14d-6989a4339972 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:36.395195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:36.395857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:36.396182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:36.396435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:36.407807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:36.409947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:36.421666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1068/2121] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:36.424473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d97a7-d9aa-4cef-b945-90ffb05cefa6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:36.425687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d97a7-d9aa-4cef-b945-90ffb05cefa6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:36.425973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d97a7-d9aa-4cef-b945-90ffb05cefa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:36.456715 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-624d97a7-d9aa-4cef-b945-90ffb05cefa6 None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:36.459218 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-624d97a7-d9aa-4cef-b945-90ffb05cefa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:36.574228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1054/2122] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 14:05:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:36.588165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:36.591531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:36.688126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0cd20-d4f3-49dc-84fe-54275e0631fe service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:36.693356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10e9d-6750-4fbc-afac-750c3b61d348 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:36.694019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10e9d-6750-4fbc-afac-750c3b61d348 service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:36.694304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10e9d-6750-4fbc-afac-750c3b61d348 service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:36.694582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10e9d-6750-4fbc-afac-750c3b61d348 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:36.710160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f10e9d-6750-4fbc-afac-750c3b61d348 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:36.712259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f10e9d-6750-4fbc-afac-750c3b61d348 service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:36.724291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1069/2123] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:05:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:05:37.157158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d97a7-d9aa-4cef-b945-90ffb05cefa6 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:37.163558 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-624d97a7-d9aa-4cef-b945-90ffb05cefa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:37.218269 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d97a7-d9aa-4cef-b945-90ffb05cefa6 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:37.230778 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:37.236392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:37.236392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:37.236392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] PATH_INFO: `/v3/projects/658de429be9b455797ab694c85cd02e9` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:37.236392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=658de429be9b455797ab694c85cd02e9)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:37.236392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:37.368341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658de429be9b455797ab694c85cd02e9', 'request_id': 'req-dc455222-4a26-4244-a761-b3830927a5e4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:37.447063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658de429be9b455797ab694c85cd02e9', 'request_id': 'req-dc455222-4a26-4244-a761-b3830927a5e4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:37.454167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658de429be9b455797ab694c85cd02e9', 'request_id': 'req-dc455222-4a26-4244-a761-b3830927a5e4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:37.481821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] The token cache is being invalidate because project 658de429be9b455797ab694c85cd02e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:37.482297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:37.488438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:37.488438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1055/2124] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:37 2022] DELETE /identity/v3/projects/658de429be9b455797ab694c85cd02e9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:37.489835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10e9d-6750-4fbc-afac-750c3b61d348 service swift] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:37.510632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10e9d-6750-4fbc-afac-750c3b61d348 service swift] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:37.608961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:37.614199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:37.614199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:37.614199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] PATH_INFO: `/v3/users/bca3950b04704cf39326328143652b23` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:37.618617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca3950b04704cf39326328143652b23)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:37.621267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:37.898450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca3950b04704cf39326328143652b23'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:37.912159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca3950b04704cf39326328143652b23'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:37.912896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca3950b04704cf39326328143652b23'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:37.916540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca3950b04704cf39326328143652b23'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:38.025777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f9bfc88e-1f4c-4b47-ba5e-94aab92cd9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca3950b04704cf39326328143652b23'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:38.055867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1070/2125] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:37 2022] DELETE /identity/v3/users/bca3950b04704cf39326328143652b23 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:38.678730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:38.680475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:38.696157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455222-4a26-4244-a761-b3830927a5e4 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:38.773807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:38.786635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:38.786635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:38.786635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] PATH_INFO: `/v3/projects/ee528fa7187940fb9cb28bd60fefb458` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:38.786635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee528fa7187940fb9cb28bd60fefb458)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:38.786635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:38.937591 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee528fa7187940fb9cb28bd60fefb458', 'request_id': 'req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:39.008685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee528fa7187940fb9cb28bd60fefb458', 'request_id': 'req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:39.014960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee528fa7187940fb9cb28bd60fefb458', 'request_id': 'req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:39.027688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] The token cache is being invalidate because project ee528fa7187940fb9cb28bd60fefb458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:39.027979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:39.028648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e6caa4c6-e311-4081-aeaa-1d5506ae5f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:39.030334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1056/2126] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:38 2022] DELETE /identity/v3/projects/ee528fa7187940fb9cb28bd60fefb458 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:39.035587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd80a-8adb-4338-806d-cd15dd8b2b01 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.036142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd80a-8adb-4338-806d-cd15dd8b2b01 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.036142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbd80a-8adb-4338-806d-cd15dd8b2b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:39.063930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-91cbd80a-8adb-4338-806d-cd15dd8b2b01 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:39.065230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-91cbd80a-8adb-4338-806d-cd15dd8b2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:39.139675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1071/2127] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:39.147076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4251b-8801-4599-abaa-e644b46cd1f6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.147559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4251b-8801-4599-abaa-e644b46cd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.147987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4251b-8801-4599-abaa-e644b46cd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:39.169363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6fd4251b-8801-4599-abaa-e644b46cd1f6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:39.170577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6fd4251b-8801-4599-abaa-e644b46cd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:39.179014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1057/2128] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:39.183395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbd80a-8adb-4338-806d-cd15dd8b2b01 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:39.193522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbd80a-8adb-4338-806d-cd15dd8b2b01 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:39.199300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:39.199992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.200276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.200561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:39.201388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:39.201697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:39.207320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:39.216723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1072/2129] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:05:39.220943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4251b-8801-4599-abaa-e644b46cd1f6 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:39.231155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4251b-8801-4599-abaa-e644b46cd1f6 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:39.235989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:39.236946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.237225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.237527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:39.238237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:39.240158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:39.543584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1058/2130] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:39 2022] POST /identity/v3/projects => generated 381 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:39.548823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:39.563575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4269ca-34f9-4804-a74a-de04f927e351 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:39.657649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a9e7b-7585-4b11-bf25-aac631328222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:39.657649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9e7b-7585-4b11-bf25-aac631328222 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.657649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9e7b-7585-4b11-bf25-aac631328222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.657649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9e7b-7585-4b11-bf25-aac631328222 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:39.658546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a9e7b-7585-4b11-bf25-aac631328222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:39.658633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a9e7b-7585-4b11-bf25-aac631328222 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:39.757544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:39.757544 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:39.777705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f601a3-9180-4000-a6a7-8da94ff61fbf admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:39.783424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:39.784324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.784611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.784889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] PATH_INFO: `/v3/users/29d0277c79194f6db186cfb205586b54` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:39.786281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d0277c79194f6db186cfb205586b54)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:39.788227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:39.888952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1073/2131] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:39 2022] POST /identity/v3/users => generated 291 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:05:39.895890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a9e7b-7585-4b11-bf25-aac631328222 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:39.913867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a9e7b-7585-4b11-bf25-aac631328222 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:39.920199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf8760-2e1e-4fb8-b36d-2d05fc84ef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:39.920885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf8760-2e1e-4fb8-b36d-2d05fc84ef64 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.921167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf8760-2e1e-4fb8-b36d-2d05fc84ef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.921472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf8760-2e1e-4fb8-b36d-2d05fc84ef64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:39.922301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf8760-2e1e-4fb8-b36d-2d05fc84ef64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:39.923901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf8760-2e1e-4fb8-b36d-2d05fc84ef64 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:39.935370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1074/2132] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:05:39.941172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf8760-2e1e-4fb8-b36d-2d05fc84ef64 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:39.954725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf8760-2e1e-4fb8-b36d-2d05fc84ef64 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:39.962316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08872-4cda-4c58-8984-6999b4758aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:39.962895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08872-4cda-4c58-8984-6999b4758aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.963187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08872-4cda-4c58-8984-6999b4758aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.963479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08872-4cda-4c58-8984-6999b4758aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:39.964746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c08872-4cda-4c58-8984-6999b4758aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:39.966516 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c08872-4cda-4c58-8984-6999b4758aa2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:39.983979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1075/2133] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:05:39.983979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f69a-f5c7-4402-9f2f-77ee7123bbdb None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:39.983979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f69a-f5c7-4402-9f2f-77ee7123bbdb None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:39.983979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f69a-f5c7-4402-9f2f-77ee7123bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:40.008460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-37a3f69a-f5c7-4402-9f2f-77ee7123bbdb None None] MFA Rules not processed for user `ecb6f1bad8054350a7e22120bfb573c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:40.009728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-37a3f69a-f5c7-4402-9f2f-77ee7123bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:40.072844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1076/2134] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:40.073846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3f69a-f5c7-4402-9f2f-77ee7123bbdb None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:40.085511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3f69a-f5c7-4402-9f2f-77ee7123bbdb None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:40.090497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50167a5-6cf2-4921-8c9f-c33374f8756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:40.091393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50167a5-6cf2-4921-8c9f-c33374f8756d admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:40.091712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50167a5-6cf2-4921-8c9f-c33374f8756d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:40.092004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50167a5-6cf2-4921-8c9f-c33374f8756d admin admin] PATH_INFO: `/v3/projects/d4fc672ec963469fa86bfdcc39d99aed/users/c0efef0fd90a45468540a7bca575bc0d/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:40.108394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50167a5-6cf2-4921-8c9f-c33374f8756d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fc672ec963469fa86bfdcc39d99aed, user_id=c0efef0fd90a45468540a7bca575bc0d, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:40.111210 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50167a5-6cf2-4921-8c9f-c33374f8756d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:40.127607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d0277c79194f6db186cfb205586b54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:40.143322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d0277c79194f6db186cfb205586b54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:40.144048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d0277c79194f6db186cfb205586b54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:40.144676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d0277c79194f6db186cfb205586b54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:40.205193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1077/2135] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:40 2022] PUT /identity/v3/projects/d4fc672ec963469fa86bfdcc39d99aed/users/c0efef0fd90a45468540a7bca575bc0d/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:40.219142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424add2-eeb2-46d1-b2f3-7416fb44c1ab None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:40.219486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424add2-eeb2-46d1-b2f3-7416fb44c1ab None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:40.219772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424add2-eeb2-46d1-b2f3-7416fb44c1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:40.234040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-772ec152-7421-4969-8019-2f01f143d458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d0277c79194f6db186cfb205586b54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:40.260215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4424add2-eeb2-46d1-b2f3-7416fb44c1ab None None] MFA Rules not processed for user `c0efef0fd90a45468540a7bca575bc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:40.262619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4424add2-eeb2-46d1-b2f3-7416fb44c1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:40.280529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1059/2136] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:39 2022] DELETE /identity/v3/users/29d0277c79194f6db186cfb205586b54 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:40.286311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692a6c-2762-4a98-8e32-94a75d419d7b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:40.288007 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692a6c-2762-4a98-8e32-94a75d419d7b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:40.288513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692a6c-2762-4a98-8e32-94a75d419d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:40.315825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-92692a6c-2762-4a98-8e32-94a75d419d7b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:40.317556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-92692a6c-2762-4a98-8e32-94a75d419d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:40.385556 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1078/2137] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:40.394463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424add2-eeb2-46d1-b2f3-7416fb44c1ab None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:40.402556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1060/2138] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:40.402868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4424add2-eeb2-46d1-b2f3-7416fb44c1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:40.412577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92692a6c-2762-4a98-8e32-94a75d419d7b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:40.414337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-92692a6c-2762-4a98-8e32-94a75d419d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:40.497926 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92692a6c-2762-4a98-8e32-94a75d419d7b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:40.507693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424add2-eeb2-46d1-b2f3-7416fb44c1ab None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:40.510492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afea27b-b04b-48a2-8943-2c47488bf3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:40.512601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afea27b-b04b-48a2-8943-2c47488bf3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:40.513329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afea27b-b04b-48a2-8943-2c47488bf3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:40.513801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afea27b-b04b-48a2-8943-2c47488bf3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:40.514502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:40.515243 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:40.515533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:40.515851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:40.517417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:40.520208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:40.528060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afea27b-b04b-48a2-8943-2c47488bf3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:40.529871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afea27b-b04b-48a2-8943-2c47488bf3e9 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:40.542844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1061/2139] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:40.767896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1079/2140] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:40 2022] POST /identity/v3/projects => generated 383 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:40.769379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afea27b-b04b-48a2-8943-2c47488bf3e9 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:40.791959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afea27b-b04b-48a2-8943-2c47488bf3e9 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:40.874519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a1568-97b2-4562-83ea-c35b7af6f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:40.875431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1568-97b2-4562-83ea-c35b7af6f089 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:40.875775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1568-97b2-4562-83ea-c35b7af6f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:40.876142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1568-97b2-4562-83ea-c35b7af6f089 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:40.877368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a1568-97b2-4562-83ea-c35b7af6f089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:40.879498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a1568-97b2-4562-83ea-c35b7af6f089 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:40.897012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:40.899879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:40.926437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34c61-8021-46f2-91c3-3734ce75b2b2 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:40.934565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:40.936060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:40.936571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:40.937044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] PATH_INFO: `/v3/projects/5bb0853cadbc43b595f2c26fdb1daa06` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:40.938891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb0853cadbc43b595f2c26fdb1daa06)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:40.940833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.106500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1062/2141] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:40 2022] POST /identity/v3/users => generated 298 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:05:41.108390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a1568-97b2-4562-83ea-c35b7af6f089 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.121841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a1568-97b2-4562-83ea-c35b7af6f089 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.137745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb0853cadbc43b595f2c26fdb1daa06', 'request_id': 'req-60449a86-d0ae-456e-a769-3dc8abc09c97'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:41.213745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71e6c-74cf-4314-833e-0d2f8167aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.214689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71e6c-74cf-4314-833e-0d2f8167aaeb admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.214985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71e6c-74cf-4314-833e-0d2f8167aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.215238 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71e6c-74cf-4314-833e-0d2f8167aaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.216406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb71e6c-74cf-4314-833e-0d2f8167aaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.218671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb71e6c-74cf-4314-833e-0d2f8167aaeb admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.233290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1063/2142] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:41.236958 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71e6c-74cf-4314-833e-0d2f8167aaeb admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.249504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71e6c-74cf-4314-833e-0d2f8167aaeb admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.262754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.264200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.264533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.264839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] PATH_INFO: `/v3/projects/529fd191a7684ab08a122e48b7b14747/users/b6283b93bc8b4755a280d4203bc37326/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.283053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb0853cadbc43b595f2c26fdb1daa06', 'request_id': 'req-60449a86-d0ae-456e-a769-3dc8abc09c97'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:41.284800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529fd191a7684ab08a122e48b7b14747, user_id=b6283b93bc8b4755a280d4203bc37326, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.287827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.289909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb0853cadbc43b595f2c26fdb1daa06', 'request_id': 'req-60449a86-d0ae-456e-a769-3dc8abc09c97'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:41.302596 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] The token cache is being invalidate because project 5bb0853cadbc43b595f2c26fdb1daa06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:41.302885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:41.303589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60449a86-d0ae-456e-a769-3dc8abc09c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:41.305146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1080/2143] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:40 2022] DELETE /identity/v3/projects/5bb0853cadbc43b595f2c26fdb1daa06 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:41.310432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1ec5e-fbf1-4bb5-a18d-71060f69bbf4 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.310725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1ec5e-fbf1-4bb5-a18d-71060f69bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.311028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1ec5e-fbf1-4bb5-a18d-71060f69bbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.330412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-29c1ec5e-fbf1-4bb5-a18d-71060f69bbf4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:41.331725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-29c1ec5e-fbf1-4bb5-a18d-71060f69bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:41.342000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1081/2144] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:41.350270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c5a7-6ad1-4e3f-a63d-3cebe2ff2c38 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.350564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c5a7-6ad1-4e3f-a63d-3cebe2ff2c38 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.350847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74c5a7-6ad1-4e3f-a63d-3cebe2ff2c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.379385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3b74c5a7-6ad1-4e3f-a63d-3cebe2ff2c38 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:41.379385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3b74c5a7-6ad1-4e3f-a63d-3cebe2ff2c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:41.382735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1082/2145] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:41.387632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74c5a7-6ad1-4e3f-a63d-3cebe2ff2c38 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.396635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74c5a7-6ad1-4e3f-a63d-3cebe2ff2c38 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.402263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.404342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.404342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.404342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.404342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:41.404912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.406471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.418265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1083/2146] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:05:41.422614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.432336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e12ea-85f4-4354-a924-e24126ad23d5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.438199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe7fc3-be52-4c3d-836a-26c260196f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.443848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe7fc3-be52-4c3d-836a-26c260196f66 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.443848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe7fc3-be52-4c3d-836a-26c260196f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.443848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe7fc3-be52-4c3d-836a-26c260196f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.443848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe7fc3-be52-4c3d-836a-26c260196f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.443848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe7fc3-be52-4c3d-836a-26c260196f66 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.447281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1064/2147] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:41 2022] PUT /identity/v3/projects/529fd191a7684ab08a122e48b7b14747/users/b6283b93bc8b4755a280d4203bc37326/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:41.452404 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.454466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:41.529753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638b6e8-dac5-4904-a289-1c581bb2ab39 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.534775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2299a5-c8e9-4d9e-9255-1e64b1999ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.535459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2299a5-c8e9-4d9e-9255-1e64b1999ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.535742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2299a5-c8e9-4d9e-9255-1e64b1999ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.536021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2299a5-c8e9-4d9e-9255-1e64b1999ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.537460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2299a5-c8e9-4d9e-9255-1e64b1999ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.538446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2299a5-c8e9-4d9e-9255-1e64b1999ea9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.549687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1065/2148] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:05:41.553765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2299a5-c8e9-4d9e-9255-1e64b1999ea9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.564505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2299a5-c8e9-4d9e-9255-1e64b1999ea9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.569370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e30e6-4565-4c91-8afd-7d15d557ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.570245 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e30e6-4565-4c91-8afd-7d15d557ae79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.570524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e30e6-4565-4c91-8afd-7d15d557ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.570801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e30e6-4565-4c91-8afd-7d15d557ae79 admin admin] PATH_INFO: `/v3/projects/529fd191a7684ab08a122e48b7b14747/users/b6283b93bc8b4755a280d4203bc37326/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.572826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e30e6-4565-4c91-8afd-7d15d557ae79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529fd191a7684ab08a122e48b7b14747, user_id=b6283b93bc8b4755a280d4203bc37326, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.576249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e30e6-4565-4c91-8afd-7d15d557ae79 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.587146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1066/2149] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:41 2022] PUT /identity/v3/projects/529fd191a7684ab08a122e48b7b14747/users/b6283b93bc8b4755a280d4203bc37326/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:41.598035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ec97-9c99-48b5-b180-bfe1e3125f74 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.598536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ec97-9c99-48b5-b180-bfe1e3125f74 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.598671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ec97-9c99-48b5-b180-bfe1e3125f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.605739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1084/2150] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:41 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:05:41.611387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe7fc3-be52-4c3d-836a-26c260196f66 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.628806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d9c4ec97-9c99-48b5-b180-bfe1e3125f74 None None] MFA Rules not processed for user `b6283b93bc8b4755a280d4203bc37326`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:41.636960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d9c4ec97-9c99-48b5-b180-bfe1e3125f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:41.686549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe7fc3-be52-4c3d-836a-26c260196f66 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.692654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5649-358e-4802-835f-dd7c5b59940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.693455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5649-358e-4802-835f-dd7c5b59940a admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.693738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5649-358e-4802-835f-dd7c5b59940a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.694016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed5649-358e-4802-835f-dd7c5b59940a admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.695015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed5649-358e-4802-835f-dd7c5b59940a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.697204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed5649-358e-4802-835f-dd7c5b59940a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.724834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1067/2151] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:41.737589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ec97-9c99-48b5-b180-bfe1e3125f74 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.739092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d9c4ec97-9c99-48b5-b180-bfe1e3125f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:41.828185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ec97-9c99-48b5-b180-bfe1e3125f74 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.833102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16078a7-b2e3-4468-b8e9-00ab6e5a8f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.833909 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16078a7-b2e3-4468-b8e9-00ab6e5a8f46 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.834319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16078a7-b2e3-4468-b8e9-00ab6e5a8f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.834826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1085/2152] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:41 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:05:41.834955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16078a7-b2e3-4468-b8e9-00ab6e5a8f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.835757 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5649-358e-4802-835f-dd7c5b59940a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.848036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16078a7-b2e3-4468-b8e9-00ab6e5a8f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.849612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed5649-358e-4802-835f-dd7c5b59940a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.849755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16078a7-b2e3-4468-b8e9-00ab6e5a8f46 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.855195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af4b7-4e6b-4f1f-b638-bbdd33c4edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.855891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af4b7-4e6b-4f1f-b638-bbdd33c4edb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.856632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af4b7-4e6b-4f1f-b638-bbdd33c4edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.856632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af4b7-4e6b-4f1f-b638-bbdd33c4edb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.857211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9af4b7-4e6b-4f1f-b638-bbdd33c4edb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.858846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9af4b7-4e6b-4f1f-b638-bbdd33c4edb0 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.862148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1068/2153] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:05:41.870879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1086/2154] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:41.875606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16078a7-b2e3-4468-b8e9-00ab6e5a8f46 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.887671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16078a7-b2e3-4468-b8e9-00ab6e5a8f46 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.892600 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594c739-7d73-41c6-a045-ff1c3455e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.893279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c739-7d73-41c6-a045-ff1c3455e435 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.893658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c739-7d73-41c6-a045-ff1c3455e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.893936 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c739-7d73-41c6-a045-ff1c3455e435 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.894757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594c739-7d73-41c6-a045-ff1c3455e435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.896547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594c739-7d73-41c6-a045-ff1c3455e435 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:41.916166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1069/2155] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:41.921662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af4b7-4e6b-4f1f-b638-bbdd33c4edb0 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:41.935767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af4b7-4e6b-4f1f-b638-bbdd33c4edb0 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:41.941498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820b683-df75-47a3-b679-8b555d0149fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:41.942525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820b683-df75-47a3-b679-8b555d0149fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:41.942806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820b683-df75-47a3-b679-8b555d0149fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:41.943105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820b683-df75-47a3-b679-8b555d0149fb admin admin] PATH_INFO: `/v3/projects/4ce4c5bab99e40258eeb2be773db75a3/users/682d27199a1542b4b67ae034fb5d883c/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:41.959836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820b683-df75-47a3-b679-8b555d0149fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce4c5bab99e40258eeb2be773db75a3, user_id=682d27199a1542b4b67ae034fb5d883c, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:41.962548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820b683-df75-47a3-b679-8b555d0149fb admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:42.116016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1087/2156] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:41 2022] PUT /identity/v3/projects/4ce4c5bab99e40258eeb2be773db75a3/users/682d27199a1542b4b67ae034fb5d883c/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:42.121668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aafefc-d52b-4ebe-8e6f-b69a2d2caaa5 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:42.121960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aafefc-d52b-4ebe-8e6f-b69a2d2caaa5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:42.122437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aafefc-d52b-4ebe-8e6f-b69a2d2caaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:42.142495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-93aafefc-d52b-4ebe-8e6f-b69a2d2caaa5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:42.144173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-93aafefc-d52b-4ebe-8e6f-b69a2d2caaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:42.144296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820b683-df75-47a3-b679-8b555d0149fb admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:42.218992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820b683-df75-47a3-b679-8b555d0149fb admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:42.222697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1070/2157] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:42.224183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:42.225282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:42.225680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:42.226443 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:42.228172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:42.235064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aafefc-d52b-4ebe-8e6f-b69a2d2caaa5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:42.236656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-93aafefc-d52b-4ebe-8e6f-b69a2d2caaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:42.342248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:42.344238 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:42.351603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aafefc-d52b-4ebe-8e6f-b69a2d2caaa5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:42.362442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1088/2158] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:42.371264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:42.371264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:42.372012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cdabd-7241-424c-af45-1d8e4409e2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:42.372012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdabd-7241-424c-af45-1d8e4409e2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:42.372279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdabd-7241-424c-af45-1d8e4409e2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:42.372357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdabd-7241-424c-af45-1d8e4409e2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:42.385797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cdabd-7241-424c-af45-1d8e4409e2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:42.387534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cdabd-7241-424c-af45-1d8e4409e2d8 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:42.388103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c8ce7-59f2-4003-9040-f6e9afd235bb service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:42.397652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:42.399541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:42.400021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:42.400595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] PATH_INFO: `/v3/users/e6aabe43b9eb428fbda523bd261c8433` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:42.401103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1071/2159] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:05:42.403947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6aabe43b9eb428fbda523bd261c8433)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:42.410986 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:42.813995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6aabe43b9eb428fbda523bd261c8433'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:42.826590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6aabe43b9eb428fbda523bd261c8433'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:42.827303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6aabe43b9eb428fbda523bd261c8433'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:42.827906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6aabe43b9eb428fbda523bd261c8433'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:42.928503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6aabe43b9eb428fbda523bd261c8433'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:42.945834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1089/2160] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:42 2022] DELETE /identity/v3/users/e6aabe43b9eb428fbda523bd261c8433 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:42.955594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b10e-7b4d-42d8-9029-f7743337585f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:42.956050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b10e-7b4d-42d8-9029-f7743337585f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:42.956328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b10e-7b4d-42d8-9029-f7743337585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:42.978933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3598b10e-7b4d-42d8-9029-f7743337585f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:42.980210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3598b10e-7b4d-42d8-9029-f7743337585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:43.054034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1072/2161] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:43.064945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:43.066352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:43.129282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e650827-b599-4400-bc57-dda542b2ca18 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:43.133009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e56770-c999-41e6-943a-f3f6a6a66afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:43.133934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e56770-c999-41e6-943a-f3f6a6a66afc service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:43.134035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e56770-c999-41e6-943a-f3f6a6a66afc service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:43.134331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e56770-c999-41e6-943a-f3f6a6a66afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:43.148172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e56770-c999-41e6-943a-f3f6a6a66afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:43.148172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e56770-c999-41e6-943a-f3f6a6a66afc service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:43.157066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b10e-7b4d-42d8-9029-f7743337585f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:43.158651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3598b10e-7b4d-42d8-9029-f7743337585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:43.160709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1090/2162] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:43.171386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b10e-7b4d-42d8-9029-f7743337585f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:43.176195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:43.177062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:43.177385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:43.177667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] PATH_INFO: `/v3/users/c0efef0fd90a45468540a7bca575bc0d` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:43.188622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0efef0fd90a45468540a7bca575bc0d)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:43.191179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:43.466359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0efef0fd90a45468540a7bca575bc0d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:43.484628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0efef0fd90a45468540a7bca575bc0d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:43.485398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0efef0fd90a45468540a7bca575bc0d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:43.486004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0efef0fd90a45468540a7bca575bc0d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:43.590540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0efef0fd90a45468540a7bca575bc0d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:43.607787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1073/2163] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:43 2022] DELETE /identity/v3/users/c0efef0fd90a45468540a7bca575bc0d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:43.609705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308a99-c395-4fa4-a6c1-3e17ecf8a2f7 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:43.610019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308a99-c395-4fa4-a6c1-3e17ecf8a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:43.610324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308a99-c395-4fa4-a6c1-3e17ecf8a2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:43.631540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a4308a99-c395-4fa4-a6c1-3e17ecf8a2f7 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:43.635481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a4308a99-c395-4fa4-a6c1-3e17ecf8a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:43.697874 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1091/2164] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:43.708596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:43.710109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:43.776312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8155bf-5dc9-40ec-84ac-471d879cd378 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:43.780449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d794707-c299-4e80-be6a-536e64de3e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:43.781112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d794707-c299-4e80-be6a-536e64de3e4b service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:43.781427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d794707-c299-4e80-be6a-536e64de3e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:43.781707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d794707-c299-4e80-be6a-536e64de3e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:43.792581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d794707-c299-4e80-be6a-536e64de3e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:43.794214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d794707-c299-4e80-be6a-536e64de3e4b service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:43.808524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1074/2165] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:43.954755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308a99-c395-4fa4-a6c1-3e17ecf8a2f7 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:43.956476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a4308a99-c395-4fa4-a6c1-3e17ecf8a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:43.975096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308a99-c395-4fa4-a6c1-3e17ecf8a2f7 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:43.980562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:43.981880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:43.982368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:43.982772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] PATH_INFO: `/v3/projects/dab88f3b75e34f828b6f5224953a0792` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:43.984185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab88f3b75e34f828b6f5224953a0792)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:43.986249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:44.154186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab88f3b75e34f828b6f5224953a0792', 'request_id': 'req-783251c7-7930-4500-9b9a-9d1c37a6b3dd'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:44.379845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab88f3b75e34f828b6f5224953a0792', 'request_id': 'req-783251c7-7930-4500-9b9a-9d1c37a6b3dd'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:44.387857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab88f3b75e34f828b6f5224953a0792', 'request_id': 'req-783251c7-7930-4500-9b9a-9d1c37a6b3dd'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:44.402801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] The token cache is being invalidate because project dab88f3b75e34f828b6f5224953a0792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:44.403032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:44.403705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:44.405357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1092/2166] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:43 2022] DELETE /identity/v3/projects/dab88f3b75e34f828b6f5224953a0792 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:44.511259 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:44.512140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2f1f-8930-4078-a03b-aab0039fe5d1 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:44.512597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2f1f-8930-4078-a03b-aab0039fe5d1 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:44.513005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2f1f-8930-4078-a03b-aab0039fe5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:44.513870 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:44.619929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3dad2f1f-8930-4078-a03b-aab0039fe5d1 None None] MFA Rules not processed for user `682d27199a1542b4b67ae034fb5d883c`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:44.622728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3dad2f1f-8930-4078-a03b-aab0039fe5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:44.695097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783251c7-7930-4500-9b9a-9d1c37a6b3dd admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:44.721775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:44.723603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:44.723908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:44.724194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] PATH_INFO: `/v3/projects/d4fc672ec963469fa86bfdcc39d99aed` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:44.727021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4fc672ec963469fa86bfdcc39d99aed)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:44.728313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1075/2167] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:44.729125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:44.747071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2f1f-8930-4078-a03b-aab0039fe5d1 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:44.747071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3dad2f1f-8930-4078-a03b-aab0039fe5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:44.832154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2f1f-8930-4078-a03b-aab0039fe5d1 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:44.837410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599468-35ae-4426-b2c0-d27a365f759d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:44.838645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599468-35ae-4426-b2c0-d27a365f759d service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:44.839105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599468-35ae-4426-b2c0-d27a365f759d service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:44.841616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599468-35ae-4426-b2c0-d27a365f759d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:44.852498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599468-35ae-4426-b2c0-d27a365f759d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:44.854204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599468-35ae-4426-b2c0-d27a365f759d service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:44.866741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1076/2168] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:44.944361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fc672ec963469fa86bfdcc39d99aed', 'request_id': 'req-69a88739-2970-4e79-a013-e6210ad4bd5a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.065202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fc672ec963469fa86bfdcc39d99aed', 'request_id': 'req-69a88739-2970-4e79-a013-e6210ad4bd5a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.077489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fc672ec963469fa86bfdcc39d99aed', 'request_id': 'req-69a88739-2970-4e79-a013-e6210ad4bd5a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.094283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] The token cache is being invalidate because project d4fc672ec963469fa86bfdcc39d99aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:45.094725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.095407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.097172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1093/2169] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:44 2022] DELETE /identity/v3/projects/d4fc672ec963469fa86bfdcc39d99aed => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:45.101729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599468-35ae-4426-b2c0-d27a365f759d service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:45.113877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599468-35ae-4426-b2c0-d27a365f759d service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:45.173551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:45.174425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:45.174706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:45.174977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] PATH_INFO: `/v3/users/b6283b93bc8b4755a280d4203bc37326` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:45.176189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6283b93bc8b4755a280d4203bc37326)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:45.178335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:45.543011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6283b93bc8b4755a280d4203bc37326'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.555686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6283b93bc8b4755a280d4203bc37326'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.556451 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6283b93bc8b4755a280d4203bc37326'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.557310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6283b93bc8b4755a280d4203bc37326'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.722905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-6befa344-678e-49a2-94f0-05478008cf4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6283b93bc8b4755a280d4203bc37326'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:45.740471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1077/2170] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:45 2022] DELETE /identity/v3/users/b6283b93bc8b4755a280d4203bc37326 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:46.639909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:46.641598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:46.662060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a88739-2970-4e79-a013-e6210ad4bd5a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:46.721567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:46.722442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:46.722726 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:46.723004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] PATH_INFO: `/v3/projects/529fd191a7684ab08a122e48b7b14747` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:46.724208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] RBAC: Authorizing `identity:delete_project(project_id=529fd191a7684ab08a122e48b7b14747)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:46.726220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:46.939935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529fd191a7684ab08a122e48b7b14747', 'request_id': 'req-7ab765e5-4fb0-41a8-a6ea-519443dc943e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:47.094827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529fd191a7684ab08a122e48b7b14747', 'request_id': 'req-7ab765e5-4fb0-41a8-a6ea-519443dc943e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:47.102076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529fd191a7684ab08a122e48b7b14747', 'request_id': 'req-7ab765e5-4fb0-41a8-a6ea-519443dc943e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:47.118437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] The token cache is being invalidate because project 529fd191a7684ab08a122e48b7b14747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:47.125679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:47.126573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7ab765e5-4fb0-41a8-a6ea-519443dc943e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:47.129309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1094/2171] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:46 2022] DELETE /identity/v3/projects/529fd191a7684ab08a122e48b7b14747 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:47.134756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78376a64-8860-4e98-82b4-44ed97a4a8a5 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.135247 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78376a64-8860-4e98-82b4-44ed97a4a8a5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.136804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78376a64-8860-4e98-82b4-44ed97a4a8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.169203 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-78376a64-8860-4e98-82b4-44ed97a4a8a5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:47.175627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-78376a64-8860-4e98-82b4-44ed97a4a8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:47.255295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1078/2172] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:47.263888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b1692-05d9-460b-8011-6e979a1fc6cc None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.264176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b1692-05d9-460b-8011-6e979a1fc6cc None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.264479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b1692-05d9-460b-8011-6e979a1fc6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.284513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-075b1692-05d9-460b-8011-6e979a1fc6cc None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:47.290053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-075b1692-05d9-460b-8011-6e979a1fc6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:47.298782 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1095/2173] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:47.303217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78376a64-8860-4e98-82b4-44ed97a4a8a5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:47.314966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78376a64-8860-4e98-82b4-44ed97a4a8a5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:47.320229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:47.321046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.321179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.321503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.322273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:47.322667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:47.324927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:47.342740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1079/2174] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:05:47.346843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b1692-05d9-460b-8011-6e979a1fc6cc None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:47.363780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b1692-05d9-460b-8011-6e979a1fc6cc None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:47.369159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca12f3b-27ae-435d-9277-6f2be977480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:47.370248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12f3b-27ae-435d-9277-6f2be977480d admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.371005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12f3b-27ae-435d-9277-6f2be977480d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.371439 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca12f3b-27ae-435d-9277-6f2be977480d admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.372305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca12f3b-27ae-435d-9277-6f2be977480d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:47.374727 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca12f3b-27ae-435d-9277-6f2be977480d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:47.534016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1096/2175] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:47 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:05:47.538422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:47.550583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43715e7f-5178-4cb1-98df-729c35a6b396 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:47.614488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9637-472a-42f9-9259-50f3d41106d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:47.615169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9637-472a-42f9-9259-50f3d41106d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.615454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9637-472a-42f9-9259-50f3d41106d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.615738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9637-472a-42f9-9259-50f3d41106d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.616429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd9637-472a-42f9-9259-50f3d41106d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:47.618593 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd9637-472a-42f9-9259-50f3d41106d1 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:47.722813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1080/2176] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:47 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:47.727027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca12f3b-27ae-435d-9277-6f2be977480d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:47.738194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca12f3b-27ae-435d-9277-6f2be977480d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:47.743135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb16e00-4ae4-45f6-86ae-8ce8734d1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:47.743842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb16e00-4ae4-45f6-86ae-8ce8734d1085 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.744129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb16e00-4ae4-45f6-86ae-8ce8734d1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.744429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb16e00-4ae4-45f6-86ae-8ce8734d1085 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.745876 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb16e00-4ae4-45f6-86ae-8ce8734d1085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:47.747652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb16e00-4ae4-45f6-86ae-8ce8734d1085 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:47.759249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1097/2177] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:47.764452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9637-472a-42f9-9259-50f3d41106d1 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:47.774777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9637-472a-42f9-9259-50f3d41106d1 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:47.779626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b8a8f-270a-4680-8824-0b113b262922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:47.780282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b8a8f-270a-4680-8824-0b113b262922 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.780562 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b8a8f-270a-4680-8824-0b113b262922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.780832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b8a8f-270a-4680-8824-0b113b262922 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.781585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b8a8f-270a-4680-8824-0b113b262922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:47.783172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b8a8f-270a-4680-8824-0b113b262922 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:47.794055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1081/2178] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:47.798172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb16e00-4ae4-45f6-86ae-8ce8734d1085 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:47.809005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb16e00-4ae4-45f6-86ae-8ce8734d1085 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:47.813790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:47.814676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.814956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.815232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] PATH_INFO: `/v3/projects/5c3f392e83b74f02847ef18dc75c37af/users/8619b8ddd1604c98a909f35637de6378/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.830992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3f392e83b74f02847ef18dc75c37af, user_id=8619b8ddd1604c98a909f35637de6378, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:47.833684 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:47.911453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1098/2179] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:47 2022] PUT /identity/v3/projects/5c3f392e83b74f02847ef18dc75c37af/users/8619b8ddd1604c98a909f35637de6378/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:47.922571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8929f-f4a1-4556-8c17-e257356a0796 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:47.922865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8929f-f4a1-4556-8c17-e257356a0796 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:47.923147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8929f-f4a1-4556-8c17-e257356a0796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:47.950916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-5cb8929f-f4a1-4556-8c17-e257356a0796 None None] MFA Rules not processed for user `8619b8ddd1604c98a909f35637de6378`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:47.952124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5cb8929f-f4a1-4556-8c17-e257356a0796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:48.018614 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1082/2180] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:48.030300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:48.032039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:48.092077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6c41f-f5a6-4ff7-88f8-d643dc28ef22 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:48.095926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73004bcf-5ca4-45b3-bf9c-0b5cd98cc19a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:48.096576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73004bcf-5ca4-45b3-bf9c-0b5cd98cc19a service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:48.096863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73004bcf-5ca4-45b3-bf9c-0b5cd98cc19a service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:48.097154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73004bcf-5ca4-45b3-bf9c-0b5cd98cc19a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:48.108119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73004bcf-5ca4-45b3-bf9c-0b5cd98cc19a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:48.108616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c34b-3e87-4ab4-a99e-f3055c5b1795 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:48.108943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c34b-3e87-4ab4-a99e-f3055c5b1795 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:48.109216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c34b-3e87-4ab4-a99e-f3055c5b1795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:48.109659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73004bcf-5ca4-45b3-bf9c-0b5cd98cc19a service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:48.120216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1099/2181] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:48.128953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1cc1c34b-3e87-4ab4-a99e-f3055c5b1795 None None] MFA Rules not processed for user `682d27199a1542b4b67ae034fb5d883c`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:48.132704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1cc1c34b-3e87-4ab4-a99e-f3055c5b1795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:48.143471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73004bcf-5ca4-45b3-bf9c-0b5cd98cc19a service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:48.194072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1083/2182] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:48.220989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73004bcf-5ca4-45b3-bf9c-0b5cd98cc19a service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:48.227070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:48.228164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:48.228600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:48.228881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] PATH_INFO: `/v3/users/8619b8ddd1604c98a909f35637de6378` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:48.230977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8619b8ddd1604c98a909f35637de6378)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:48.232955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:48.616461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8619b8ddd1604c98a909f35637de6378'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:48.630660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8619b8ddd1604c98a909f35637de6378'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:48.631410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8619b8ddd1604c98a909f35637de6378'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:48.632037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8619b8ddd1604c98a909f35637de6378'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:48.727951 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8619b8ddd1604c98a909f35637de6378'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:48.741702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1100/2183] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:05:48 2022] DELETE /identity/v3/users/8619b8ddd1604c98a909f35637de6378 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:05:48.747304 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315617d-3949-46ec-ad76-940f7ec780da None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:48.752515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315617d-3949-46ec-ad76-940f7ec780da None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:48.752515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315617d-3949-46ec-ad76-940f7ec780da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:48.767662 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-5315617d-3949-46ec-ad76-940f7ec780da None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:48.768801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5315617d-3949-46ec-ad76-940f7ec780da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:48.849819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1084/2184] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:05:48.863549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:48.864979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:48.922785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d19b78-1fb9-4a8c-bb88-975698af7e2b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:48.926448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e596c-f820-447f-bbb8-d65e4bb23a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:48.927123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e596c-f820-447f-bbb8-d65e4bb23a14 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:48.927407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e596c-f820-447f-bbb8-d65e4bb23a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:48.927707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e596c-f820-447f-bbb8-d65e4bb23a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:48.938274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e596c-f820-447f-bbb8-d65e4bb23a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:48.939937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e596c-f820-447f-bbb8-d65e4bb23a14 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:48.951042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1101/2185] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:05:49.536388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315617d-3949-46ec-ad76-940f7ec780da None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:49.538315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5315617d-3949-46ec-ad76-940f7ec780da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:49.551928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315617d-3949-46ec-ad76-940f7ec780da None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:49.563073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:49.564198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:49.565210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:49.565594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] PATH_INFO: `/v3/projects/5c3f392e83b74f02847ef18dc75c37af` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:49.567095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3f392e83b74f02847ef18dc75c37af)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:49.569015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:49.767385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3f392e83b74f02847ef18dc75c37af', 'request_id': 'req-36dac271-209d-4278-8d0e-0ea1a6e564ef'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:49.922663 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3f392e83b74f02847ef18dc75c37af', 'request_id': 'req-36dac271-209d-4278-8d0e-0ea1a6e564ef'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:49.929121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3f392e83b74f02847ef18dc75c37af', 'request_id': 'req-36dac271-209d-4278-8d0e-0ea1a6e564ef'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:49.941371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] The token cache is being invalidate because project 5c3f392e83b74f02847ef18dc75c37af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:05:49.941840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:49.942496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36dac271-209d-4278-8d0e-0ea1a6e564ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:05:49.944252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1085/2186] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:05:49 2022] DELETE /identity/v3/projects/5c3f392e83b74f02847ef18dc75c37af => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:49.949310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac051b-1191-40f1-8f1b-9e325ec52a67 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:49.950124 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac051b-1191-40f1-8f1b-9e325ec52a67 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:49.950124 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac051b-1191-40f1-8f1b-9e325ec52a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:49.970735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f1ac051b-1191-40f1-8f1b-9e325ec52a67 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:49.971992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f1ac051b-1191-40f1-8f1b-9e325ec52a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:50.040183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1102/2187] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:50.049555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0746c-5e11-48a5-8783-64e0432ca683 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:50.049846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0746c-5e11-48a5-8783-64e0432ca683 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:50.050125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0746c-5e11-48a5-8783-64e0432ca683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:50.068777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-33b0746c-5e11-48a5-8783-64e0432ca683 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:50.070151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-33b0746c-5e11-48a5-8783-64e0432ca683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:50.079508 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1086/2188] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:50.093402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac051b-1191-40f1-8f1b-9e325ec52a67 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:50.102993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac051b-1191-40f1-8f1b-9e325ec52a67 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:50.108576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:50.109300 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:50.109587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:50.109868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:50.110838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:05:50.110956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:50.112564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:50.125519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1103/2189] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:05:50.130749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0746c-5e11-48a5-8783-64e0432ca683 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:50.140568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0746c-5e11-48a5-8783-64e0432ca683 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:50.145650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f1b4d-8082-421e-9140-6d41273cadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:50.146307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1b4d-8082-421e-9140-6d41273cadf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:50.146589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1b4d-8082-421e-9140-6d41273cadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:50.146863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1b4d-8082-421e-9140-6d41273cadf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:50.147564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f1b4d-8082-421e-9140-6d41273cadf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:50.149503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f1b4d-8082-421e-9140-6d41273cadf2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:50.316437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1087/2190] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:05:50 2022] POST /identity/v3/projects => generated 399 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:05:50.317688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:50.328494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d6b7-0c9e-4585-ba85-6c926a8fb9de admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:50.398944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a7bf9-c5c9-45bc-9911-92d6d26fb8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:50.399689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a7bf9-c5c9-45bc-9911-92d6d26fb8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:50.399922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a7bf9-c5c9-45bc-9911-92d6d26fb8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:50.400200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a7bf9-c5c9-45bc-9911-92d6d26fb8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:50.400922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a7bf9-c5c9-45bc-9911-92d6d26fb8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:50.403640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a7bf9-c5c9-45bc-9911-92d6d26fb8d0 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:50.625436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1104/2191] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:05:50 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:05:50.626637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f1b4d-8082-421e-9140-6d41273cadf2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:50.637785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f1b4d-8082-421e-9140-6d41273cadf2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:50.643165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd599a6f-0be7-4732-8d1f-aade7ef24d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:50.643838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd599a6f-0be7-4732-8d1f-aade7ef24d4b admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:50.644116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd599a6f-0be7-4732-8d1f-aade7ef24d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:50.644387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd599a6f-0be7-4732-8d1f-aade7ef24d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:50.645170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd599a6f-0be7-4732-8d1f-aade7ef24d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:50.646996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd599a6f-0be7-4732-8d1f-aade7ef24d4b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:50.658923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1088/2192] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:50.663062 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a7bf9-c5c9-45bc-9911-92d6d26fb8d0 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:50.674178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a7bf9-c5c9-45bc-9911-92d6d26fb8d0 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:50.686522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6231a-f54e-416d-a763-a26d09250900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:50.686522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6231a-f54e-416d-a763-a26d09250900 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:50.686522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6231a-f54e-416d-a763-a26d09250900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:50.686522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6231a-f54e-416d-a763-a26d09250900 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:50.686982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6231a-f54e-416d-a763-a26d09250900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:50.686982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6231a-f54e-416d-a763-a26d09250900 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:50.693339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1105/2193] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:05:50.697613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd599a6f-0be7-4732-8d1f-aade7ef24d4b admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:50.708172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd599a6f-0be7-4732-8d1f-aade7ef24d4b admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:50.712879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:50.714342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:50.714626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:50.714898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] PATH_INFO: `/v3/projects/c99bc36fb0c94dbabe55b0904a37f69e/users/8a2a39f51ed944248879811f7f859c87/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:50.730755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99bc36fb0c94dbabe55b0904a37f69e, user_id=8a2a39f51ed944248879811f7f859c87, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:50.733499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:51.025170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1089/2194] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:05:50 2022] PUT /identity/v3/projects/c99bc36fb0c94dbabe55b0904a37f69e/users/8a2a39f51ed944248879811f7f859c87/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:05:51.035213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a737-d276-4794-bbb5-fa726bbb6b4c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:51.041442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a737-d276-4794-bbb5-fa726bbb6b4c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:51.041442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a737-d276-4794-bbb5-fa726bbb6b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:51.063120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f571a737-d276-4794-bbb5-fa726bbb6b4c None None] MFA Rules not processed for user `8a2a39f51ed944248879811f7f859c87`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:05:51.066306 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f571a737-d276-4794-bbb5-fa726bbb6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:51.149520 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1106/2195] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:05:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:05:51.162169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:05:51.164189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:05:51.233652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625a8f-02f5-448d-b905-ab4e2d44ff40 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:05:51.238309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:05:51.239195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:05:51.239672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:05:51.240003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:05:51.251321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:05:51.254552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:05:51.266931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1090/2196] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:05:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:00.186579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce095e6-8fbb-41a0-a12e-54a462f0b7b3 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:00.187801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce095e6-8fbb-41a0-a12e-54a462f0b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:00.188232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce095e6-8fbb-41a0-a12e-54a462f0b7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:00.251331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9ce095e6-8fbb-41a0-a12e-54a462f0b7b3 None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:00.252896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9ce095e6-8fbb-41a0-a12e-54a462f0b7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:00.333464 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1107/2197] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:06:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:06:00.345474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:00.348074 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:00.569785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47a0df-681f-4393-b831-61da1c4d65f9 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:00.575473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223da8ff-81c7-44ae-8edc-c533122c3f41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:00.576272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223da8ff-81c7-44ae-8edc-c533122c3f41 service swift] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:00.576658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223da8ff-81c7-44ae-8edc-c533122c3f41 service swift] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:00.577069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223da8ff-81c7-44ae-8edc-c533122c3f41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:00.586090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223da8ff-81c7-44ae-8edc-c533122c3f41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:00.587685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223da8ff-81c7-44ae-8edc-c533122c3f41 service swift] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:00.596648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1091/2198] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:06:00.946597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce095e6-8fbb-41a0-a12e-54a462f0b7b3 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:01.072742 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce095e6-8fbb-41a0-a12e-54a462f0b7b3 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:01.102309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:01.104015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:01.104478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:01.105761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] PATH_INFO: `/v3/users/8a2a39f51ed944248879811f7f859c87` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:01.109920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2a39f51ed944248879811f7f859c87)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:01.111983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:01.433655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2a39f51ed944248879811f7f859c87'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:01.463059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2a39f51ed944248879811f7f859c87'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:01.464537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2a39f51ed944248879811f7f859c87'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:01.465490 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2a39f51ed944248879811f7f859c87'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:01.591362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2a39f51ed944248879811f7f859c87'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:01.687559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1108/2199] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:06:00 2022] DELETE /identity/v3/users/8a2a39f51ed944248879811f7f859c87 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:06:01.692459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490902-fc71-412d-8408-f0f97ce16a70 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:01.693041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490902-fc71-412d-8408-f0f97ce16a70 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:01.693041 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490902-fc71-412d-8408-f0f97ce16a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:01.722386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0a490902-fc71-412d-8408-f0f97ce16a70 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:01.726162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0a490902-fc71-412d-8408-f0f97ce16a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:01.825615 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1092/2200] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:01.835523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:01.840692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:01.934258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f904f-c079-469e-83f6-0429ce5a55d5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:01.941386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad071f99-8f2b-4565-bef9-c14bb9b490b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:01.942063 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad071f99-8f2b-4565-bef9-c14bb9b490b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:01.942348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad071f99-8f2b-4565-bef9-c14bb9b490b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:01.942625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad071f99-8f2b-4565-bef9-c14bb9b490b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:01.953326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad071f99-8f2b-4565-bef9-c14bb9b490b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:01.954704 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad071f99-8f2b-4565-bef9-c14bb9b490b4 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:01.972985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1109/2201] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:03.097860 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490902-fc71-412d-8408-f0f97ce16a70 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:03.100047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0a490902-fc71-412d-8408-f0f97ce16a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:03.125085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490902-fc71-412d-8408-f0f97ce16a70 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:03.131814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:03.136971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:03.136971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:03.136971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] PATH_INFO: `/v3/projects/c99bc36fb0c94dbabe55b0904a37f69e` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:03.136971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99bc36fb0c94dbabe55b0904a37f69e)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:03.138834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:03.465182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99bc36fb0c94dbabe55b0904a37f69e', 'request_id': 'req-c9a90b65-8915-49b4-9e16-0ac39d65de8b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:03.676978 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99bc36fb0c94dbabe55b0904a37f69e', 'request_id': 'req-c9a90b65-8915-49b4-9e16-0ac39d65de8b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:03.695547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99bc36fb0c94dbabe55b0904a37f69e', 'request_id': 'req-c9a90b65-8915-49b4-9e16-0ac39d65de8b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:03.726035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] The token cache is being invalidate because project c99bc36fb0c94dbabe55b0904a37f69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:06:03.726360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:03.727081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-c9a90b65-8915-49b4-9e16-0ac39d65de8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:06:03.736250 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1093/2202] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:06:03 2022] DELETE /identity/v3/projects/c99bc36fb0c94dbabe55b0904a37f69e => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:06:03.737942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5074-af74-41a6-ba85-36575e311a88 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:03.738466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5074-af74-41a6-ba85-36575e311a88 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:03.738466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5074-af74-41a6-ba85-36575e311a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:03.775625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-58cc5074-af74-41a6-ba85-36575e311a88 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:03.777754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-58cc5074-af74-41a6-ba85-36575e311a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:03.937465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1110/2203] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:03.942633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac333b-a95f-4057-be7f-facc9ff82fc9 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:03.948391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac333b-a95f-4057-be7f-facc9ff82fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:03.948391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac333b-a95f-4057-be7f-facc9ff82fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:04.000289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-ddac333b-a95f-4057-be7f-facc9ff82fc9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:04.002161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ddac333b-a95f-4057-be7f-facc9ff82fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:04.017980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1094/2204] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:04.020076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc5074-af74-41a6-ba85-36575e311a88 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:04.034253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc5074-af74-41a6-ba85-36575e311a88 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:04.051075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:04.051983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:04.052826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:04.052826 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:04.053649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:06:04.054052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:04.055765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:04.077698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1111/2205] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:06:04.079572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac333b-a95f-4057-be7f-facc9ff82fc9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:04.097609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac333b-a95f-4057-be7f-facc9ff82fc9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:04.108861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5917-7bd3-4e0e-b16b-4b594709fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:04.110390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5917-7bd3-4e0e-b16b-4b594709fccf admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:04.111117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5917-7bd3-4e0e-b16b-4b594709fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:04.111939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5917-7bd3-4e0e-b16b-4b594709fccf admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:04.114443 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5917-7bd3-4e0e-b16b-4b594709fccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:04.119102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5917-7bd3-4e0e-b16b-4b594709fccf admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:04.273739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1095/2206] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:06:04 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:06:04.277809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:04.293471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f153792-b9bd-441a-b492-df4c647ac467 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:04.381010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d4378-c19a-4b5e-8f76-759178988175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:04.381601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4378-c19a-4b5e-8f76-759178988175 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:04.381601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4378-c19a-4b5e-8f76-759178988175 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:04.381938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4378-c19a-4b5e-8f76-759178988175 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:04.382522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d4378-c19a-4b5e-8f76-759178988175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:04.384573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d4378-c19a-4b5e-8f76-759178988175 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:04.553357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1112/2207] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:06:04 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:06:04.579895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5917-7bd3-4e0e-b16b-4b594709fccf admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:04.579895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5917-7bd3-4e0e-b16b-4b594709fccf admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:04.581746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3cdb5-5292-4d49-923e-e15e8a7b85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:04.582434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3cdb5-5292-4d49-923e-e15e8a7b85ce admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:04.582718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3cdb5-5292-4d49-923e-e15e8a7b85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:04.582994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3cdb5-5292-4d49-923e-e15e8a7b85ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:04.583895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3cdb5-5292-4d49-923e-e15e8a7b85ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:04.585530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3cdb5-5292-4d49-923e-e15e8a7b85ce admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:04.602153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1096/2208] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:06:04.603483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d4378-c19a-4b5e-8f76-759178988175 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:04.617949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d4378-c19a-4b5e-8f76-759178988175 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:04.623323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fed6eb-7e9e-4ff9-bb6a-0147f2f7d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:04.624081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fed6eb-7e9e-4ff9-bb6a-0147f2f7d571 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:04.624453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fed6eb-7e9e-4ff9-bb6a-0147f2f7d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:04.624796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fed6eb-7e9e-4ff9-bb6a-0147f2f7d571 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:04.625658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fed6eb-7e9e-4ff9-bb6a-0147f2f7d571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:04.627774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fed6eb-7e9e-4ff9-bb6a-0147f2f7d571 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:04.640316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1113/2209] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:06:04.644458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3cdb5-5292-4d49-923e-e15e8a7b85ce admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:04.660655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3cdb5-5292-4d49-923e-e15e8a7b85ce admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:04.667109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:04.668021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:04.668329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:04.668564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] PATH_INFO: `/v3/projects/1625f082167647399a6211547163cb93/users/4290947cee5b49dda7f75d4656d4e834/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:04.687784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1625f082167647399a6211547163cb93, user_id=4290947cee5b49dda7f75d4656d4e834, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:04.690477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:04.866736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1097/2210] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:06:04 2022] PUT /identity/v3/projects/1625f082167647399a6211547163cb93/users/4290947cee5b49dda7f75d4656d4e834/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:06:04.876144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d142-98a3-4c4f-9260-5c18b12a268d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:04.877061 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d142-98a3-4c4f-9260-5c18b12a268d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:04.877716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d142-98a3-4c4f-9260-5c18b12a268d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:04.941837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1f79d142-98a3-4c4f-9260-5c18b12a268d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:04.949159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1f79d142-98a3-4c4f-9260-5c18b12a268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:05.147926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1114/2211] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:05.162032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:05.163858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:05.241536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59914aaf-2a5e-4899-b121-a56f65c2deea admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:05.247880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eebfc-53cd-45f4-a6fd-cfb0eef72a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:05.248636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eebfc-53cd-45f4-a6fd-cfb0eef72a51 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:05.248990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eebfc-53cd-45f4-a6fd-cfb0eef72a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:05.249429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eebfc-53cd-45f4-a6fd-cfb0eef72a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:05.259576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eebfc-53cd-45f4-a6fd-cfb0eef72a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:05.261847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eebfc-53cd-45f4-a6fd-cfb0eef72a51 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:05.272005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1098/2212] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:15.834173 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa892-757e-48b2-8c7d-f487921919ba None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:15.834723 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa892-757e-48b2-8c7d-f487921919ba None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:15.834895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa892-757e-48b2-8c7d-f487921919ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:15.867211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-398fa892-757e-48b2-8c7d-f487921919ba None None] MFA Rules not processed for user `4290947cee5b49dda7f75d4656d4e834`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:15.868540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-398fa892-757e-48b2-8c7d-f487921919ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:15.991382 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1115/2213] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:06:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:15.997175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eebfc-53cd-45f4-a6fd-cfb0eef72a51 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:16.008057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eebfc-53cd-45f4-a6fd-cfb0eef72a51 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:16.014109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347963ff-ae7a-46c4-a74a-86a718118102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:16.014787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347963ff-ae7a-46c4-a74a-86a718118102 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:16.015070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347963ff-ae7a-46c4-a74a-86a718118102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:16.015350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347963ff-ae7a-46c4-a74a-86a718118102 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:16.016092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347963ff-ae7a-46c4-a74a-86a718118102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:16.018683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347963ff-ae7a-46c4-a74a-86a718118102 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:16.159524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1099/2214] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:06:15 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:06:16.163637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fa892-757e-48b2-8c7d-f487921919ba None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:16.177923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fa892-757e-48b2-8c7d-f487921919ba None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:16.248754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76077d-0cb9-46b5-a060-ca761a7aaff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:16.248754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76077d-0cb9-46b5-a060-ca761a7aaff8 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:16.248754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76077d-0cb9-46b5-a060-ca761a7aaff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:16.248754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76077d-0cb9-46b5-a060-ca761a7aaff8 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:16.249215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76077d-0cb9-46b5-a060-ca761a7aaff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:16.250529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76077d-0cb9-46b5-a060-ca761a7aaff8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:16.424089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1116/2215] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:06:16 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:06:16.428686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347963ff-ae7a-46c4-a74a-86a718118102 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:16.443635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347963ff-ae7a-46c4-a74a-86a718118102 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:16.451100 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6aa46-7e3b-4716-9535-8fb7626159f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:16.452408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6aa46-7e3b-4716-9535-8fb7626159f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:16.452810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6aa46-7e3b-4716-9535-8fb7626159f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:16.453192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6aa46-7e3b-4716-9535-8fb7626159f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:16.454306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6aa46-7e3b-4716-9535-8fb7626159f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:16.456685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6aa46-7e3b-4716-9535-8fb7626159f8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:16.473138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1100/2216] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:06:16.477318 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76077d-0cb9-46b5-a060-ca761a7aaff8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:16.498686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76077d-0cb9-46b5-a060-ca761a7aaff8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:16.503958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a113fb2-466c-4b33-bfb7-e70232b32647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:16.504866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113fb2-466c-4b33-bfb7-e70232b32647 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:16.512400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113fb2-466c-4b33-bfb7-e70232b32647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:16.512400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113fb2-466c-4b33-bfb7-e70232b32647 admin admin] PATH_INFO: `/v3/projects/aa556b788bd248e5ae368d0e57530638/users/0e8ae8e8db6c45e280282f600af05854/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:16.524824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a113fb2-466c-4b33-bfb7-e70232b32647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa556b788bd248e5ae368d0e57530638, user_id=0e8ae8e8db6c45e280282f600af05854, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:16.529183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a113fb2-466c-4b33-bfb7-e70232b32647 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:16.643416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1117/2217] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:06:16 2022] PUT /identity/v3/projects/aa556b788bd248e5ae368d0e57530638/users/0e8ae8e8db6c45e280282f600af05854/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:06:16.647638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6aa46-7e3b-4716-9535-8fb7626159f8 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:16.659364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6aa46-7e3b-4716-9535-8fb7626159f8 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:16.719669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f33b0b-aade-4604-b503-c03e5f1ef1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:16.720350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33b0b-aade-4604-b503-c03e5f1ef1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:16.720635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33b0b-aade-4604-b503-c03e5f1ef1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:16.720915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f33b0b-aade-4604-b503-c03e5f1ef1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:16.721690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f33b0b-aade-4604-b503-c03e5f1ef1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:16.723318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f33b0b-aade-4604-b503-c03e5f1ef1c8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:16.734128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1101/2218] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:06:16.738504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a113fb2-466c-4b33-bfb7-e70232b32647 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:16.749787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a113fb2-466c-4b33-bfb7-e70232b32647 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:16.756120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:16.757375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:16.757833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:16.758110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] PATH_INFO: `/v3/projects/aa556b788bd248e5ae368d0e57530638/users/0e8ae8e8db6c45e280282f600af05854/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:16.760165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa556b788bd248e5ae368d0e57530638, user_id=0e8ae8e8db6c45e280282f600af05854, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:16.764028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:16.775186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1118/2219] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:06:16 2022] PUT /identity/v3/projects/aa556b788bd248e5ae368d0e57530638/users/0e8ae8e8db6c45e280282f600af05854/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:06:24.204228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae217b3-9f81-4d90-ae35-1b868bc65d28 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:24.205323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae217b3-9f81-4d90-ae35-1b868bc65d28 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:24.205741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae217b3-9f81-4d90-ae35-1b868bc65d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:24.266449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3ae217b3-9f81-4d90-ae35-1b868bc65d28 None None] MFA Rules not processed for user `0e8ae8e8db6c45e280282f600af05854`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:24.267849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3ae217b3-9f81-4d90-ae35-1b868bc65d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:24.396123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1102/2220] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:24.408888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:24.410879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:24.513324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b97994-1b0b-45c4-ae75-ca521571951f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:24.519694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbff89d-47b2-422a-985b-e57fa2d94c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:24.520364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbff89d-47b2-422a-985b-e57fa2d94c8c service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:24.520715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbff89d-47b2-422a-985b-e57fa2d94c8c service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:24.521005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbff89d-47b2-422a-985b-e57fa2d94c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:24.586291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbff89d-47b2-422a-985b-e57fa2d94c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:24.588090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbff89d-47b2-422a-985b-e57fa2d94c8c service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:24.599563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1119/2221] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:06:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:24.769202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb619c-bb54-4190-b59c-3794672abacc None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:24.769591 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb619c-bb54-4190-b59c-3794672abacc None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:24.769986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb619c-bb54-4190-b59c-3794672abacc None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:24.771759 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1103/2222] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:06:24.778037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324990-b95c-4974-a5fc-acfd8bfc19f5 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:24.778355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324990-b95c-4974-a5fc-acfd8bfc19f5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:24.778808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324990-b95c-4974-a5fc-acfd8bfc19f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:24.822396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-11324990-b95c-4974-a5fc-acfd8bfc19f5 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:24.824586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-11324990-b95c-4974-a5fc-acfd8bfc19f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:24.835319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1120/2223] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:06:24.847777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb619c-bb54-4190-b59c-3794672abacc None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:24.849771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-28fb619c-bb54-4190-b59c-3794672abacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:24.940670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb619c-bb54-4190-b59c-3794672abacc None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:24.944500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc139d6-62ff-499d-8d43-adcd08edbcef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d96159b7fb49c08b1f5c014d26f79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:24.945189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc139d6-62ff-499d-8d43-adcd08edbcef service glance] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:24.945512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc139d6-62ff-499d-8d43-adcd08edbcef service glance] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:24.945788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc139d6-62ff-499d-8d43-adcd08edbcef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:24.956426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc139d6-62ff-499d-8d43-adcd08edbcef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:24.957908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc139d6-62ff-499d-8d43-adcd08edbcef service glance] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:24.968766 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1104/2224] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:06:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:25.193611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfaba7-a14e-41c0-af7d-3b5e8bb43e27 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:25.193980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfaba7-a14e-41c0-af7d-3b5e8bb43e27 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:25.194356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfaba7-a14e-41c0-af7d-3b5e8bb43e27 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:25.201624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1121/2225] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:06:25.202081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e9d18-964a-49b0-8a0b-ea4c9fd2c941 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:25.202081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e9d18-964a-49b0-8a0b-ea4c9fd2c941 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:25.202081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e9d18-964a-49b0-8a0b-ea4c9fd2c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:25.221151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-670e9d18-964a-49b0-8a0b-ea4c9fd2c941 None None] MFA Rules not processed for user `378bf86fc54142ee85dc16cce3664978`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:25.222422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-670e9d18-964a-49b0-8a0b-ea4c9fd2c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:25.288496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1105/2226] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:25.299564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfaba7-a14e-41c0-af7d-3b5e8bb43e27 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:25.315948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfaba7-a14e-41c0-af7d-3b5e8bb43e27 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:25.315948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12850357-14e8-4387-907d-a9c909133606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:25.316629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850357-14e8-4387-907d-a9c909133606 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:25.316629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850357-14e8-4387-907d-a9c909133606 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:25.316897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12850357-14e8-4387-907d-a9c909133606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:25.325473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12850357-14e8-4387-907d-a9c909133606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:25.327676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12850357-14e8-4387-907d-a9c909133606 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:25.336588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1122/2227] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:25.458914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052e4eb-e7bf-4cb5-8712-2d30e83ce52a None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:25.459223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052e4eb-e7bf-4cb5-8712-2d30e83ce52a None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:25.459965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052e4eb-e7bf-4cb5-8712-2d30e83ce52a None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:25.461526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1106/2228] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:06:25.470615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb4d19-a09b-4087-a642-69e0d92d3c53 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:25.471217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb4d19-a09b-4087-a642-69e0d92d3c53 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:25.471217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb4d19-a09b-4087-a642-69e0d92d3c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:25.497125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-55cb4d19-a09b-4087-a642-69e0d92d3c53 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:25.498977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-55cb4d19-a09b-4087-a642-69e0d92d3c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:25.509893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1123/2229] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:25.521498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052e4eb-e7bf-4cb5-8712-2d30e83ce52a None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:25.536413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052e4eb-e7bf-4cb5-8712-2d30e83ce52a None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:25.542131 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:25.542948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:25.543249 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:25.543522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:25.560962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:25.561525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:25.578288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1107/2230] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:27.105124 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb4d19-a09b-4087-a642-69e0d92d3c53 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:27.107271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-55cb4d19-a09b-4087-a642-69e0d92d3c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:27.128612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb4d19-a09b-4087-a642-69e0d92d3c53 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:27.133312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bcf72-fcb5-4f23-acb6-af97127360e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:27.134431 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bcf72-fcb5-4f23-acb6-af97127360e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:27.134865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bcf72-fcb5-4f23-acb6-af97127360e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:27.135383 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bcf72-fcb5-4f23-acb6-af97127360e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:27.138411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-529bcf72-fcb5-4f23-acb6-af97127360e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:27.293353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bcf72-fcb5-4f23-acb6-af97127360e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:27.296012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bcf72-fcb5-4f23-acb6-af97127360e7 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:27.321363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1124/2231] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:06:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:33.470685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:33.472093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:33.571720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a6f1-3515-465c-947b-17d60cd1aeda service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:33.577433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bed7f-d7ec-40e8-a568-923e18653bf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ffd2170c2243eab4511fced8d67ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:33.585280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bed7f-d7ec-40e8-a568-923e18653bf9 service placement] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:33.585280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bed7f-d7ec-40e8-a568-923e18653bf9 service placement] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:33.585280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bed7f-d7ec-40e8-a568-923e18653bf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:33.585280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f83bed7f-d7ec-40e8-a568-923e18653bf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:33.593883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bed7f-d7ec-40e8-a568-923e18653bf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:33.595609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bed7f-d7ec-40e8-a568-923e18653bf9 service placement] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:33.613513 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1108/2232] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:06:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:06:35.440029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3460d66-d923-43b5-a983-63e9bc5b9449 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:35.440641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3460d66-d923-43b5-a983-63e9bc5b9449 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:35.440883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3460d66-d923-43b5-a983-63e9bc5b9449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:35.459517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c3460d66-d923-43b5-a983-63e9bc5b9449 None None] MFA Rules not processed for user `5987014231084f679a795a88f14ad02e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:35.460648 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c3460d66-d923-43b5-a983-63e9bc5b9449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:35.521934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1125/2233] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:35.931160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba863e0-f25f-40de-8af8-8233084e108e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:35.931684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba863e0-f25f-40de-8af8-8233084e108e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:35.932374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba863e0-f25f-40de-8af8-8233084e108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:35.953705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-2ba863e0-f25f-40de-8af8-8233084e108e None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:35.955348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2ba863e0-f25f-40de-8af8-8233084e108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:36.032596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1109/2234] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:06:36.059209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3460d66-d923-43b5-a983-63e9bc5b9449 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:36.060967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c3460d66-d923-43b5-a983-63e9bc5b9449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:36.157274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3460d66-d923-43b5-a983-63e9bc5b9449 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:36.162772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fff554-4e48-4330-98ac-208a25e01f29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:36.163510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff554-4e48-4330-98ac-208a25e01f29 service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:36.163863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff554-4e48-4330-98ac-208a25e01f29 service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:36.164153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff554-4e48-4330-98ac-208a25e01f29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:36.174113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fff554-4e48-4330-98ac-208a25e01f29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:36.175888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fff554-4e48-4330-98ac-208a25e01f29 service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:36.185013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1126/2235] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:06:51.664669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e9b3-3c76-4627-9bdc-e21c70e0454e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:51.665407 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e9b3-3c76-4627-9bdc-e21c70e0454e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:51.665407 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52e9b3-3c76-4627-9bdc-e21c70e0454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:51.686671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4a52e9b3-3c76-4627-9bdc-e21c70e0454e None None] MFA Rules not processed for user `4290947cee5b49dda7f75d4656d4e834`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:06:51.688431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4a52e9b3-3c76-4627-9bdc-e21c70e0454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:51.698009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1110/2236] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:07:04.989548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66f26-173f-477c-b404-a7be4a65d719 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:07:04.994485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66f26-173f-477c-b404-a7be4a65d719 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:07:04.994485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66f26-173f-477c-b404-a7be4a65d719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:07:05.023030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-aab66f26-173f-477c-b404-a7be4a65d719 None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:07:05.024308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-aab66f26-173f-477c-b404-a7be4a65d719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:07:05.032983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1127/2237] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:07:05.046229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e9b3-3c76-4627-9bdc-e21c70e0454e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:07:05.058110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52e9b3-3c76-4627-9bdc-e21c70e0454e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:07:05.063932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e317fb-b168-40f0-9051-e66c251ce466 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:07:05.064520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e317fb-b168-40f0-9051-e66c251ce466 service swift] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:07:05.064811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e317fb-b168-40f0-9051-e66c251ce466 service swift] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:07:05.065205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e317fb-b168-40f0-9051-e66c251ce466 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:07:05.074758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e317fb-b168-40f0-9051-e66c251ce466 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:07:05.076503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e317fb-b168-40f0-9051-e66c251ce466 service swift] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:07:05.085135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1111/2238] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:07:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:07:26.469209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab66f26-173f-477c-b404-a7be4a65d719 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:07:26.489934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab66f26-173f-477c-b404-a7be4a65d719 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:07:26.494021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1cf49-8e8d-4adb-a88f-c8edb594f415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:07:26.494740 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1cf49-8e8d-4adb-a88f-c8edb594f415 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:07:26.495020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1cf49-8e8d-4adb-a88f-c8edb594f415 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:07:26.496322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1cf49-8e8d-4adb-a88f-c8edb594f415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:07:26.507050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1cf49-8e8d-4adb-a88f-c8edb594f415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:07:26.508560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1cf49-8e8d-4adb-a88f-c8edb594f415 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:07:26.519131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1128/2239] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:07:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:07:44.120535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54093-a894-4b9e-91d7-08e464f34c80 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:07:44.121090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54093-a894-4b9e-91d7-08e464f34c80 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:07:44.121090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54093-a894-4b9e-91d7-08e464f34c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:07:44.138943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4fc54093-a894-4b9e-91d7-08e464f34c80 None None] MFA Rules not processed for user `682d27199a1542b4b67ae034fb5d883c`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:07:44.140179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4fc54093-a894-4b9e-91d7-08e464f34c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:07:44.197547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1112/2240] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:07:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:07:52.439058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51db5b-dc37-4581-9324-559086792685 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:07:52.439607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51db5b-dc37-4581-9324-559086792685 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:07:52.439607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51db5b-dc37-4581-9324-559086792685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:07:52.457068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-fd51db5b-dc37-4581-9324-559086792685 None None] MFA Rules not processed for user `ecb6f1bad8054350a7e22120bfb573c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:07:52.458270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-fd51db5b-dc37-4581-9324-559086792685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:07:52.510207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1129/2241] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:08:27.909917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc54093-a894-4b9e-91d7-08e464f34c80 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:27.920033 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc54093-a894-4b9e-91d7-08e464f34c80 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:27.923869 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3081dd-50de-4436-88ac-9896decc8195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:27.924527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3081dd-50de-4436-88ac-9896decc8195 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:27.925002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3081dd-50de-4436-88ac-9896decc8195 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:27.925301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3081dd-50de-4436-88ac-9896decc8195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:27.927316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9f3081dd-50de-4436-88ac-9896decc8195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:27.941425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3081dd-50de-4436-88ac-9896decc8195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:27.948108 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3081dd-50de-4436-88ac-9896decc8195 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:27.955231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1113/2242] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:08:29.171204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51db5b-dc37-4581-9324-559086792685 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:29.181223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51db5b-dc37-4581-9324-559086792685 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:29.185536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:29.186190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:29.186474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:29.186753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:29.189743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:29.207833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:29.209312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:29.220735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1130/2243] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:08:29.238585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3fc3-c93b-4cfb-a413-a06d3039ce67 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:29.239146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3fc3-c93b-4cfb-a413-a06d3039ce67 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:29.239251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3fc3-c93b-4cfb-a413-a06d3039ce67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:29.259217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-293f3fc3-c93b-4cfb-a413-a06d3039ce67 None None] MFA Rules not processed for user `b32e32eb1444401b9b7d8ab3228bdfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:08:29.261145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-293f3fc3-c93b-4cfb-a413-a06d3039ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:29.322199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1114/2244] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:08:42.540479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:42.542751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:42.599866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f3fc3-c93b-4cfb-a413-a06d3039ce67 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:42.602611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b77fe-d823-4b3a-9e06-af35535b71c6 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:42.607758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9daed1c-9995-41bf-97d7-599e04bbd779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:42.608410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daed1c-9995-41bf-97d7-599e04bbd779 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:42.608696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daed1c-9995-41bf-97d7-599e04bbd779 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:42.608976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daed1c-9995-41bf-97d7-599e04bbd779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:42.610820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d9daed1c-9995-41bf-97d7-599e04bbd779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:42.613230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f3fc3-c93b-4cfb-a413-a06d3039ce67 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:42.624126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebb004-8eb2-443a-8602-5f30631e0b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:42.624895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb004-8eb2-443a-8602-5f30631e0b45 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:42.625260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb004-8eb2-443a-8602-5f30631e0b45 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:42.625620 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebb004-8eb2-443a-8602-5f30631e0b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:42.625769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9daed1c-9995-41bf-97d7-599e04bbd779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:42.627079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9daed1c-9995-41bf-97d7-599e04bbd779 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:42.636252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebb004-8eb2-443a-8602-5f30631e0b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:42.637891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1131/2245] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:08:42.638225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebb004-8eb2-443a-8602-5f30631e0b45 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:42.649221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1115/2246] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:08:43.135257 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426b5d2-cf11-43aa-828b-b35239a29165 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:43.135535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426b5d2-cf11-43aa-828b-b35239a29165 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:43.135932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426b5d2-cf11-43aa-828b-b35239a29165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:43.157566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0426b5d2-cf11-43aa-828b-b35239a29165 None None] MFA Rules not processed for user `5987014231084f679a795a88f14ad02e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:08:43.158833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0426b5d2-cf11-43aa-828b-b35239a29165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:43.168181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1132/2247] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:08:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:08:43.528144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebb004-8eb2-443a-8602-5f30631e0b45 service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:43.540292 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebb004-8eb2-443a-8602-5f30631e0b45 service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:43.544389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:43.545119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:43.545766 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:43.546044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:43.548470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:43.559811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:43.561348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:43.570181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1116/2248] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:08:44.323964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426b5d2-cf11-43aa-828b-b35239a29165 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:44.329093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0426b5d2-cf11-43aa-828b-b35239a29165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:44.351406 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426b5d2-cf11-43aa-828b-b35239a29165 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:44.357709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb12e1-ac96-4114-9418-c248e72eda12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ffd2170c2243eab4511fced8d67ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:44.358375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb12e1-ac96-4114-9418-c248e72eda12 service placement] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:44.358715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb12e1-ac96-4114-9418-c248e72eda12 service placement] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:44.358996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb12e1-ac96-4114-9418-c248e72eda12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:44.362321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d1fb12e1-ac96-4114-9418-c248e72eda12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:44.390792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb12e1-ac96-4114-9418-c248e72eda12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:44.394722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb12e1-ac96-4114-9418-c248e72eda12 service placement] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:44.411417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1133/2249] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:08:44.412258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:44.413796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:44.433091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b756a-1f0c-451d-9913-acf5ba66e358 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:44.442844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:44.443537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:44.443818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:44.444362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:44.455828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:44.524148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:44.526429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:44.561604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1117/2250] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:08:47.467186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96281d17-ceb6-4bd6-a5a7-ab5e2d78925d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:47.467707 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96281d17-ceb6-4bd6-a5a7-ab5e2d78925d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:47.467823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96281d17-ceb6-4bd6-a5a7-ab5e2d78925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:47.484972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-96281d17-ceb6-4bd6-a5a7-ab5e2d78925d None None] MFA Rules not processed for user `0ca157aeabbb4f9da8475ca002dd0239`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:08:47.486242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-96281d17-ceb6-4bd6-a5a7-ab5e2d78925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:47.493342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1134/2251] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:08:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:08:48.872407 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:48.882408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af89b-7737-45cc-a641-cbaa60ebfae3 service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:48.886356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:48.887014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:48.887463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:48.887924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:48.889844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:48.901760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:48.903376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:48.912949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1118/2252] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:08:49.642573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96281d17-ceb6-4bd6-a5a7-ab5e2d78925d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:08:49.658086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96281d17-ceb6-4bd6-a5a7-ab5e2d78925d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:08:49.663704 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:08:49.664271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:08:49.664733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:08:49.665163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:08:49.668007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:08:49.687660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:08:49.691923 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:08:49.710340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1135/2253] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:08:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:02.002428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:02.004004 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:02.070252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b787a6-a213-4e0f-a412-9b7f68f4afdc service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:02.075858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:02.076768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:02.077014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:02.077315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] PATH_INFO: `/v3/users/682d27199a1542b4b67ae034fb5d883c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:02.078530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=682d27199a1542b4b67ae034fb5d883c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:02.080514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:02.275754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682d27199a1542b4b67ae034fb5d883c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:02.291147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682d27199a1542b4b67ae034fb5d883c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:02.291359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682d27199a1542b4b67ae034fb5d883c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:02.292128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682d27199a1542b4b67ae034fb5d883c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:02.418716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682d27199a1542b4b67ae034fb5d883c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:02.435575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1119/2254] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:09:02 2022] DELETE /identity/v3/users/682d27199a1542b4b67ae034fb5d883c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:02.897602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:02.912050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7edc9-2e6d-4ce6-89ed-c8fa52f55ba4 service nova] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:02.980016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:02.981010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:02.981510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:02.981796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] PATH_INFO: `/v3/projects/4ce4c5bab99e40258eeb2be773db75a3` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:02.989230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce4c5bab99e40258eeb2be773db75a3)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:02.991302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:03.101946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce4c5bab99e40258eeb2be773db75a3', 'request_id': 'req-e228bd31-4e27-488a-9424-22784260e9ea'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:03.167644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce4c5bab99e40258eeb2be773db75a3', 'request_id': 'req-e228bd31-4e27-488a-9424-22784260e9ea'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:03.173871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce4c5bab99e40258eeb2be773db75a3', 'request_id': 'req-e228bd31-4e27-488a-9424-22784260e9ea'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:03.186512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] The token cache is being invalidate because project 4ce4c5bab99e40258eeb2be773db75a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:09:03.186793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:03.187451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:03.189011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1136/2255] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:09:02 2022] DELETE /identity/v3/projects/4ce4c5bab99e40258eeb2be773db75a3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:04.152139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:04.154195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:04.239068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb760c49-8494-47cd-b982-d7976b2ce5dc admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:04.309540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:04.310219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:04.310507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:04.310787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:04.313109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:04.326076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:04.328798 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:04.345431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1120/2256] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:05.604919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:05.606322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:05.622423 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bd31-4e27-488a-9424-22784260e9ea admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:05.628183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:05.628845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:05.629158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:05.629484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:05.631581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:05.646710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:05.648332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:05.660268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1137/2257] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:10.137259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:10.138668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:10.194844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2757b-8ab2-4696-ba75-f0bae935ecf4 service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:10.199259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:10.199902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:10.200186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:10.200465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:10.202271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:10.267575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:10.269021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:10.278777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1121/2258] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:14.625177 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:14.626766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:14.642565 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383ee2d-2ad7-4267-ae3b-067787206adc service nova] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:14.647277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:14.648083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:14.648375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:14.648677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] PATH_INFO: `/v3/users/ecb6f1bad8054350a7e22120bfb573c6` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:14.651822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb6f1bad8054350a7e22120bfb573c6)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:14.653804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:14.869661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb6f1bad8054350a7e22120bfb573c6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:14.883120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb6f1bad8054350a7e22120bfb573c6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:14.883869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb6f1bad8054350a7e22120bfb573c6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:14.885323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb6f1bad8054350a7e22120bfb573c6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:15.012644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4fd2222c-da6b-415b-829f-e17d4036324d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb6f1bad8054350a7e22120bfb573c6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:15.026983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1138/2259] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:09:14 2022] DELETE /identity/v3/users/ecb6f1bad8054350a7e22120bfb573c6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:15.275500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:15.285977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ff0e3-bdb4-4ef6-883f-eb89fb8335c9 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:15.346797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:15.347646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:15.347932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:15.348194 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] PATH_INFO: `/v3/projects/373030cbd19f4dcc88d9b494dee196bc` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:15.349417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=373030cbd19f4dcc88d9b494dee196bc)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:15.351324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:15.511799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373030cbd19f4dcc88d9b494dee196bc', 'request_id': 'req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:15.607397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373030cbd19f4dcc88d9b494dee196bc', 'request_id': 'req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:15.615960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373030cbd19f4dcc88d9b494dee196bc', 'request_id': 'req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:15.625680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] The token cache is being invalidate because project 373030cbd19f4dcc88d9b494dee196bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:09:15.625972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:15.626624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0c1d7ed7-d2f6-4fc1-a5a6-d2d4bf5fbd4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:15.628354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1122/2260] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:09:15 2022] DELETE /identity/v3/projects/373030cbd19f4dcc88d9b494dee196bc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:15.633626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09299dc-d081-4b3a-b3ad-1d59781c0f0d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:15.634141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09299dc-d081-4b3a-b3ad-1d59781c0f0d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:15.634871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09299dc-d081-4b3a-b3ad-1d59781c0f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:15.654307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d09299dc-d081-4b3a-b3ad-1d59781c0f0d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:15.655527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d09299dc-d081-4b3a-b3ad-1d59781c0f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:15.721643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1139/2261] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:15.729838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289086e-1afb-4ce6-99d2-cc5a323b479d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:15.730128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289086e-1afb-4ce6-99d2-cc5a323b479d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:15.730406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289086e-1afb-4ce6-99d2-cc5a323b479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:15.749987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6289086e-1afb-4ce6-99d2-cc5a323b479d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:15.751190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6289086e-1afb-4ce6-99d2-cc5a323b479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:15.766121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1123/2262] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:09:15.770532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09299dc-d081-4b3a-b3ad-1d59781c0f0d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:15.780337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09299dc-d081-4b3a-b3ad-1d59781c0f0d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:15.784927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:15.785613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:15.786055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:15.786335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:15.787065 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:09:15.787368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:15.789025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:15.802205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1140/2263] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:09:15.808298 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289086e-1afb-4ce6-99d2-cc5a323b479d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:15.817862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289086e-1afb-4ce6-99d2-cc5a323b479d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:15.824162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:15.824815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:15.825097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:15.825402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:15.826094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:15.827984 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:15.918650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1124/2264] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:09:15 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:15.923091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:15.933518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64adacc-6f4a-4023-aca1-398a43ef017c admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:16.004877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:16.005718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.006549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.007000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.007884 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:16.010295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:16.093423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:16.100602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:16.160743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1141/2265] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:09:15 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:16.160743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:16.160743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:16.182880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4bd13-e8d1-4e72-87f2-2caff4b11fce admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:16.190519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:16.191321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.191607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.192116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.199022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:16.214229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:16.215954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:16.229077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1125/2266] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:16.230128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:16.239121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2cd0-3d48-496a-b599-cb8965e7b4e7 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:16.240677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655748ee-0731-475d-b6c2-f81221abb507 service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:16.243231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:16.244517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.244798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.245070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.246893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:16.247882 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f74d6-5609-4490-b05b-d9a05ec41b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:16.248781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f74d6-5609-4490-b05b-d9a05ec41b53 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.249272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f74d6-5609-4490-b05b-d9a05ec41b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.254257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f74d6-5609-4490-b05b-d9a05ec41b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.254257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f74d6-5609-4490-b05b-d9a05ec41b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:16.254257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f74d6-5609-4490-b05b-d9a05ec41b53 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:16.266294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:16.268845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:16.272554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1126/2267] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:16.277712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f74d6-5609-4490-b05b-d9a05ec41b53 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:16.284776 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1142/2268] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:16.289157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f74d6-5609-4490-b05b-d9a05ec41b53 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:16.295059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735838-9257-4dc4-9202-43fab88fc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:16.295925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735838-9257-4dc4-9202-43fab88fc8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.296329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735838-9257-4dc4-9202-43fab88fc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.296469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735838-9257-4dc4-9202-43fab88fc8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.297207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735838-9257-4dc4-9202-43fab88fc8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:16.298851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735838-9257-4dc4-9202-43fab88fc8f7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:16.310553 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1127/2269] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:09:16.317094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:16.327622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1ddae-2c76-402f-a66b-38f1d5b6a062 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:16.332569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:16.333937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.334236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.334474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] PATH_INFO: `/v3/projects/06ec7bc3489b4e4f9829eafc2dda774f/users/b715cbd75bf94c3282b6acd1e04f4870/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.353978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ec7bc3489b4e4f9829eafc2dda774f, user_id=b715cbd75bf94c3282b6acd1e04f4870, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:16.356962 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:16.483958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1143/2270] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:16 2022] PUT /identity/v3/projects/06ec7bc3489b4e4f9829eafc2dda774f/users/b715cbd75bf94c3282b6acd1e04f4870/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:16.495980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ded8-e7f1-4417-b379-0f66704012b2 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.496268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ded8-e7f1-4417-b379-0f66704012b2 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.496576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9ded8-e7f1-4417-b379-0f66704012b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.523697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-90b9ded8-e7f1-4417-b379-0f66704012b2 None None] MFA Rules not processed for user `b715cbd75bf94c3282b6acd1e04f4870`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:16.525576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-90b9ded8-e7f1-4417-b379-0f66704012b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:16.599584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1128/2271] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:16.612165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:16.614268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:16.694352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5f24b-31a6-4729-9ec3-43c7f0d1cbbf admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:16.700776 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c3fb-341a-4893-b7b8-ccf157f31602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:16.701449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c3fb-341a-4893-b7b8-ccf157f31602 service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.701735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c3fb-341a-4893-b7b8-ccf157f31602 service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.702080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c3fb-341a-4893-b7b8-ccf157f31602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.710425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67c3fb-341a-4893-b7b8-ccf157f31602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:16.712029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67c3fb-341a-4893-b7b8-ccf157f31602 service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:16.715315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1a7b2-ca19-4720-8bc3-f408b70a15eb None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.716343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1a7b2-ca19-4720-8bc3-f408b70a15eb None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.717062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1a7b2-ca19-4720-8bc3-f408b70a15eb None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.719916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1129/2272] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:09:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:09:16.723052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1144/2273] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:16.726524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd2e2-6c2f-49de-8d87-593943ab52c9 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.726993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd2e2-6c2f-49de-8d87-593943ab52c9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.727279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd2e2-6c2f-49de-8d87-593943ab52c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.753845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-423cd2e2-6c2f-49de-8d87-593943ab52c9 None None] MFA Rules not processed for user `378bf86fc54142ee85dc16cce3664978`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:16.753845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-423cd2e2-6c2f-49de-8d87-593943ab52c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:16.808144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1130/2274] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:16.820746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c3fb-341a-4893-b7b8-ccf157f31602 service nova] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:16.830880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c3fb-341a-4893-b7b8-ccf157f31602 service nova] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:16.834883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc77121-c2f5-4fd2-ad34-d121680c5b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:16.835749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc77121-c2f5-4fd2-ad34-d121680c5b09 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.836037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc77121-c2f5-4fd2-ad34-d121680c5b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.836342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc77121-c2f5-4fd2-ad34-d121680c5b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.844532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc77121-c2f5-4fd2-ad34-d121680c5b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:16.846047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc77121-c2f5-4fd2-ad34-d121680c5b09 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:16.854472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1145/2275] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:16.938337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3930-01e5-4bdf-8a64-e0b3d7f928b7 None None] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.938631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3930-01e5-4bdf-8a64-e0b3d7f928b7 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.938912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c3930-01e5-4bdf-8a64-e0b3d7f928b7 None None] PATH_INFO: `/` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.940350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1131/2276] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 14:09:16.946012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008c2a-e805-471c-91c6-dd01b3e3c391 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:16.946306 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008c2a-e805-471c-91c6-dd01b3e3c391 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:16.946584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008c2a-e805-471c-91c6-dd01b3e3c391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:16.965761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-e3008c2a-e805-471c-91c6-dd01b3e3c391 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:16.966957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e3008c2a-e805-471c-91c6-dd01b3e3c391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:16.976180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1146/2277] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:16.986618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c3930-01e5-4bdf-8a64-e0b3d7f928b7 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:16.998445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c3930-01e5-4bdf-8a64-e0b3d7f928b7 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:17.004739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c440-d2ef-4b94-8dae-5eed66ecb9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:17.005365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c440-d2ef-4b94-8dae-5eed66ecb9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:17.005645 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c440-d2ef-4b94-8dae-5eed66ecb9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:17.006222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c440-d2ef-4b94-8dae-5eed66ecb9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:17.017566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c440-d2ef-4b94-8dae-5eed66ecb9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:17.018995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c440-d2ef-4b94-8dae-5eed66ecb9e1 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:17.029599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1132/2278] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:20.147582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008c2a-e805-471c-91c6-dd01b3e3c391 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:20.218991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008c2a-e805-471c-91c6-dd01b3e3c391 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:20.223702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:20.224612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:20.224896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:20.225204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] PATH_INFO: `/v3/users/b715cbd75bf94c3282b6acd1e04f4870` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:20.226465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b715cbd75bf94c3282b6acd1e04f4870)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:20.228425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:20.626984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b715cbd75bf94c3282b6acd1e04f4870'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:20.646755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b715cbd75bf94c3282b6acd1e04f4870'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:20.647471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b715cbd75bf94c3282b6acd1e04f4870'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:20.648908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b715cbd75bf94c3282b6acd1e04f4870'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:20.783599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b715cbd75bf94c3282b6acd1e04f4870'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:20.797473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1147/2279] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:09:20 2022] DELETE /identity/v3/users/b715cbd75bf94c3282b6acd1e04f4870 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:20.801836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a55d8-f07b-4e01-a15f-11ce9b8087d8 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:20.802328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a55d8-f07b-4e01-a15f-11ce9b8087d8 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:20.802432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a55d8-f07b-4e01-a15f-11ce9b8087d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:20.824409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-200a55d8-f07b-4e01-a15f-11ce9b8087d8 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:20.824409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-200a55d8-f07b-4e01-a15f-11ce9b8087d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:20.884124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1133/2280] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:20.894758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:20.896341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:20.955746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab8fbf-cdeb-4f58-8485-587f805665e6 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:20.959334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0c2ae-14a5-4567-8cbc-6d68ac256424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:20.959974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c2ae-14a5-4567-8cbc-6d68ac256424 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:20.960253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c2ae-14a5-4567-8cbc-6d68ac256424 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:20.960523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0c2ae-14a5-4567-8cbc-6d68ac256424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:20.970293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0c2ae-14a5-4567-8cbc-6d68ac256424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:20.972070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0c2ae-14a5-4567-8cbc-6d68ac256424 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:20.981775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1148/2281] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:21.413474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a55d8-f07b-4e01-a15f-11ce9b8087d8 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:21.413474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-200a55d8-f07b-4e01-a15f-11ce9b8087d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:21.422494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a55d8-f07b-4e01-a15f-11ce9b8087d8 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:21.430141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:21.431356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:21.432120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:21.432120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] PATH_INFO: `/v3/projects/06ec7bc3489b4e4f9829eafc2dda774f` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:21.434572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ec7bc3489b4e4f9829eafc2dda774f)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:21.436679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:21.578572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ec7bc3489b4e4f9829eafc2dda774f', 'request_id': 'req-8002445e-8d62-48b1-8043-f952e701b3d4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:21.641108 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ec7bc3489b4e4f9829eafc2dda774f', 'request_id': 'req-8002445e-8d62-48b1-8043-f952e701b3d4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:21.647749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ec7bc3489b4e4f9829eafc2dda774f', 'request_id': 'req-8002445e-8d62-48b1-8043-f952e701b3d4'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:21.659942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] The token cache is being invalidate because project 06ec7bc3489b4e4f9829eafc2dda774f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:09:21.660236 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:21.660901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8002445e-8d62-48b1-8043-f952e701b3d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:21.662519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1134/2282] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:09:21 2022] DELETE /identity/v3/projects/06ec7bc3489b4e4f9829eafc2dda774f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:21.668657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbd48-7236-458f-acf8-f90ceb1b0f51 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:21.669163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbd48-7236-458f-acf8-f90ceb1b0f51 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:21.669295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbd48-7236-458f-acf8-f90ceb1b0f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:21.688441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-596bbd48-7236-458f-acf8-f90ceb1b0f51 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:21.689717 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-596bbd48-7236-458f-acf8-f90ceb1b0f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:21.749274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1149/2283] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:21.758584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fba75-f839-49d5-a03f-6209aaa9c312 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:21.758977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fba75-f839-49d5-a03f-6209aaa9c312 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:21.759263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fba75-f839-49d5-a03f-6209aaa9c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:21.784504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-311fba75-f839-49d5-a03f-6209aaa9c312 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:21.785771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-311fba75-f839-49d5-a03f-6209aaa9c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:21.794792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1135/2284] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:21.799132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bbd48-7236-458f-acf8-f90ceb1b0f51 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:21.809459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bbd48-7236-458f-acf8-f90ceb1b0f51 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:21.814109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:21.814770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:21.815082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:21.815359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:21.816146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:09:21.816450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:21.818112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:21.830265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1150/2285] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:09:21.834994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fba75-f839-49d5-a03f-6209aaa9c312 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:21.845676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fba75-f839-49d5-a03f-6209aaa9c312 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:21.850422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85466d-e1d0-4fc2-874f-166084c06a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:21.851075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85466d-e1d0-4fc2-874f-166084c06a09 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:21.851357 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85466d-e1d0-4fc2-874f-166084c06a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:21.851635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85466d-e1d0-4fc2-874f-166084c06a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:21.852333 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85466d-e1d0-4fc2-874f-166084c06a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:21.854271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85466d-e1d0-4fc2-874f-166084c06a09 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:22.098094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1136/2286] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:09:21 2022] POST /identity/v3/projects => generated 403 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:22.102559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:22.112871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd000f67-131b-4829-adda-2f3d11046fb8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:22.169421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63560c-6afc-49f7-a503-78b184ec882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:22.170117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63560c-6afc-49f7-a503-78b184ec882f admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:22.170402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63560c-6afc-49f7-a503-78b184ec882f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:22.170685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63560c-6afc-49f7-a503-78b184ec882f admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:22.171384 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63560c-6afc-49f7-a503-78b184ec882f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:22.173358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63560c-6afc-49f7-a503-78b184ec882f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:22.290535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1151/2287] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:09:22 2022] POST /identity/v3/users => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:22.296077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85466d-e1d0-4fc2-874f-166084c06a09 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:22.306270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85466d-e1d0-4fc2-874f-166084c06a09 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:22.311566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9c11-bb22-42e5-ab34-c749918a4437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:22.312224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9c11-bb22-42e5-ab34-c749918a4437 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:22.312503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9c11-bb22-42e5-ab34-c749918a4437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:22.312777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b9c11-bb22-42e5-ab34-c749918a4437 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:22.313534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b9c11-bb22-42e5-ab34-c749918a4437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:22.315183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b9c11-bb22-42e5-ab34-c749918a4437 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:22.326788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1137/2288] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:09:22.331115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63560c-6afc-49f7-a503-78b184ec882f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:22.341960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63560c-6afc-49f7-a503-78b184ec882f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:22.346697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d54f-7c2b-4640-9edf-8aba3c2655de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:22.347352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d54f-7c2b-4640-9edf-8aba3c2655de admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:22.347636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d54f-7c2b-4640-9edf-8aba3c2655de admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:22.347963 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d54f-7c2b-4640-9edf-8aba3c2655de admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:22.348767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d54f-7c2b-4640-9edf-8aba3c2655de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:22.350350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d54f-7c2b-4640-9edf-8aba3c2655de admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:22.361511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1152/2289] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:22.365823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9c11-bb22-42e5-ab34-c749918a4437 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:22.376085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b9c11-bb22-42e5-ab34-c749918a4437 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:22.381130 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef244c-f4b9-48ec-af14-0fd31843768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:22.382055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef244c-f4b9-48ec-af14-0fd31843768e admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:22.382345 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef244c-f4b9-48ec-af14-0fd31843768e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:22.382623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef244c-f4b9-48ec-af14-0fd31843768e admin admin] PATH_INFO: `/v3/projects/dcb1c40d221d42ef9379029c8f79c4ea/users/0e876cb76537496a8d0af4881f4b7111/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:22.397646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef244c-f4b9-48ec-af14-0fd31843768e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb1c40d221d42ef9379029c8f79c4ea, user_id=0e876cb76537496a8d0af4881f4b7111, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:22.400305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef244c-f4b9-48ec-af14-0fd31843768e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:22.479697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1138/2290] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:22 2022] PUT /identity/v3/projects/dcb1c40d221d42ef9379029c8f79c4ea/users/0e876cb76537496a8d0af4881f4b7111/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:22.490668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c514-1d9c-4892-b244-197b3264bf44 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:22.494394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c514-1d9c-4892-b244-197b3264bf44 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:22.494394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726c514-1d9c-4892-b244-197b3264bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:22.519150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9726c514-1d9c-4892-b244-197b3264bf44 None None] MFA Rules not processed for user `0e876cb76537496a8d0af4881f4b7111`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:22.520183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9726c514-1d9c-4892-b244-197b3264bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:22.585998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1153/2291] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:22.591295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef244c-f4b9-48ec-af14-0fd31843768e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:22.661974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef244c-f4b9-48ec-af14-0fd31843768e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:22.666708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79095af-2ea0-4c95-8baf-e231d8b074c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:22.667377 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79095af-2ea0-4c95-8baf-e231d8b074c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:22.667801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79095af-2ea0-4c95-8baf-e231d8b074c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:22.668079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79095af-2ea0-4c95-8baf-e231d8b074c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:22.668773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79095af-2ea0-4c95-8baf-e231d8b074c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:22.670760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79095af-2ea0-4c95-8baf-e231d8b074c7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:22.780423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1139/2292] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:09:22 2022] POST /identity/v3/projects => generated 405 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:22.784465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c514-1d9c-4892-b244-197b3264bf44 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:22.795203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726c514-1d9c-4892-b244-197b3264bf44 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:22.853165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64384de-d95f-4ef8-a040-737e40ed963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:22.853872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64384de-d95f-4ef8-a040-737e40ed963b admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:22.854157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64384de-d95f-4ef8-a040-737e40ed963b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:22.854435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64384de-d95f-4ef8-a040-737e40ed963b admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:22.855620 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64384de-d95f-4ef8-a040-737e40ed963b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:22.857597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64384de-d95f-4ef8-a040-737e40ed963b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:22.964476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1154/2293] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:09:22 2022] POST /identity/v3/users => generated 309 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:22.968417 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79095af-2ea0-4c95-8baf-e231d8b074c7 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:22.978875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79095af-2ea0-4c95-8baf-e231d8b074c7 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:22.983564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efe82c-0955-40ca-9b68-91c232146dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:22.984225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe82c-0955-40ca-9b68-91c232146dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:22.984510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe82c-0955-40ca-9b68-91c232146dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:22.984817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe82c-0955-40ca-9b68-91c232146dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:22.985607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efe82c-0955-40ca-9b68-91c232146dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:22.987206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efe82c-0955-40ca-9b68-91c232146dc8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:22.998601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1140/2294] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:23.002819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64384de-d95f-4ef8-a040-737e40ed963b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:23.014027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64384de-d95f-4ef8-a040-737e40ed963b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:23.018753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067a90f-da97-47a2-87cd-3a87d6085afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:23.019631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067a90f-da97-47a2-87cd-3a87d6085afd admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:23.019921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067a90f-da97-47a2-87cd-3a87d6085afd admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:23.020199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067a90f-da97-47a2-87cd-3a87d6085afd admin admin] PATH_INFO: `/v3/projects/785ed8c8950d431c994b3ee80a55f736/users/4f154cea1d464cddb1a6854bcfe51c3d/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:23.035085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067a90f-da97-47a2-87cd-3a87d6085afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=785ed8c8950d431c994b3ee80a55f736, user_id=4f154cea1d464cddb1a6854bcfe51c3d, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:23.037783 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067a90f-da97-47a2-87cd-3a87d6085afd admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:23.113786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1155/2295] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:23 2022] PUT /identity/v3/projects/785ed8c8950d431c994b3ee80a55f736/users/4f154cea1d464cddb1a6854bcfe51c3d/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:23.117892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efe82c-0955-40ca-9b68-91c232146dc8 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:23.131765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efe82c-0955-40ca-9b68-91c232146dc8 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:23.191533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae31a0-1119-4175-9c63-c76b07bce43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:23.192241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae31a0-1119-4175-9c63-c76b07bce43c admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:23.192524 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae31a0-1119-4175-9c63-c76b07bce43c admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:23.192830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae31a0-1119-4175-9c63-c76b07bce43c admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:23.193585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae31a0-1119-4175-9c63-c76b07bce43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:23.195179 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae31a0-1119-4175-9c63-c76b07bce43c admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:23.205714 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1141/2296] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:23.209940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067a90f-da97-47a2-87cd-3a87d6085afd admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:23.220690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067a90f-da97-47a2-87cd-3a87d6085afd admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:23.225172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:23.226076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:23.227060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:23.227366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] PATH_INFO: `/v3/projects/785ed8c8950d431c994b3ee80a55f736/users/4f154cea1d464cddb1a6854bcfe51c3d/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:23.229340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=785ed8c8950d431c994b3ee80a55f736, user_id=4f154cea1d464cddb1a6854bcfe51c3d, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:23.232051 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:23.242409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1156/2297] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:23 2022] PUT /identity/v3/projects/785ed8c8950d431c994b3ee80a55f736/users/4f154cea1d464cddb1a6854bcfe51c3d/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:23.254858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21855-67c5-439c-af42-436ffc4b3f41 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:23.255184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21855-67c5-439c-af42-436ffc4b3f41 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:23.255599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a21855-67c5-439c-af42-436ffc4b3f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:23.283913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-53a21855-67c5-439c-af42-436ffc4b3f41 None None] MFA Rules not processed for user `4f154cea1d464cddb1a6854bcfe51c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:23.285120 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-53a21855-67c5-439c-af42-436ffc4b3f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:23.353328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1142/2298] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:23.365477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:23.367354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:23.427276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13219a18-7ebe-44e6-a3f5-14c6c8994419 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:23.431059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43436791-2c08-48c5-8975-686fb1d9c951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:23.431701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436791-2c08-48c5-8975-686fb1d9c951 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:23.431991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436791-2c08-48c5-8975-686fb1d9c951 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:23.432278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436791-2c08-48c5-8975-686fb1d9c951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:23.442312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43436791-2c08-48c5-8975-686fb1d9c951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:23.443743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43436791-2c08-48c5-8975-686fb1d9c951 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:23.453598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1157/2299] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:23 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:23.599800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a21855-67c5-439c-af42-436ffc4b3f41 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:23.664583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a21855-67c5-439c-af42-436ffc4b3f41 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:23.669751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:23.670615 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:23.670899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:23.671175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] PATH_INFO: `/v3/users/0e876cb76537496a8d0af4881f4b7111` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:23.672366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e876cb76537496a8d0af4881f4b7111)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:23.674333 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:23.895838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e876cb76537496a8d0af4881f4b7111'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:23.907854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e876cb76537496a8d0af4881f4b7111'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:23.908593 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e876cb76537496a8d0af4881f4b7111'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:23.909205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e876cb76537496a8d0af4881f4b7111'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:24.000932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e876cb76537496a8d0af4881f4b7111'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:24.014905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1143/2300] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:09:23 2022] DELETE /identity/v3/users/0e876cb76537496a8d0af4881f4b7111 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:24.019519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72227b02-94ed-43db-8e16-f9c56ef7b8b1 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:24.019992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72227b02-94ed-43db-8e16-f9c56ef7b8b1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:24.020175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72227b02-94ed-43db-8e16-f9c56ef7b8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:24.039563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-72227b02-94ed-43db-8e16-f9c56ef7b8b1 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:24.040845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-72227b02-94ed-43db-8e16-f9c56ef7b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:24.100823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1158/2301] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:24.110983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:24.112429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:24.171505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8cd94-4b26-452e-be9b-6b55fa2dcd77 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:24.175118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8a6d7-6eaf-4341-8ca0-a5ced2892630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:24.175761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8a6d7-6eaf-4341-8ca0-a5ced2892630 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:24.176046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8a6d7-6eaf-4341-8ca0-a5ced2892630 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:24.176326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8a6d7-6eaf-4341-8ca0-a5ced2892630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:24.186075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8a6d7-6eaf-4341-8ca0-a5ced2892630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:24.187507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8a6d7-6eaf-4341-8ca0-a5ced2892630 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:24.197011 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1144/2302] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:24.638882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72227b02-94ed-43db-8e16-f9c56ef7b8b1 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:24.641405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-72227b02-94ed-43db-8e16-f9c56ef7b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:24.659001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72227b02-94ed-43db-8e16-f9c56ef7b8b1 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:24.664758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:24.665708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:24.665992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:24.666297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] PATH_INFO: `/v3/projects/dcb1c40d221d42ef9379029c8f79c4ea` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:24.667581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb1c40d221d42ef9379029c8f79c4ea)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:24.670760 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:24.866890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb1c40d221d42ef9379029c8f79c4ea', 'request_id': 'req-225124d3-fecc-4a2a-a82f-f1da64d4dc99'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:24.942163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb1c40d221d42ef9379029c8f79c4ea', 'request_id': 'req-225124d3-fecc-4a2a-a82f-f1da64d4dc99'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:24.948481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb1c40d221d42ef9379029c8f79c4ea', 'request_id': 'req-225124d3-fecc-4a2a-a82f-f1da64d4dc99'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:24.959916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] The token cache is being invalidate because project dcb1c40d221d42ef9379029c8f79c4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:09:24.960209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:24.960859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:24.962427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1159/2303] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:09:24 2022] DELETE /identity/v3/projects/dcb1c40d221d42ef9379029c8f79c4ea => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:24.966569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8a6d7-6eaf-4341-8ca0-a5ced2892630 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:24.976175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8a6d7-6eaf-4341-8ca0-a5ced2892630 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:25.034540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:25.035338 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:25.035621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:25.035898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] PATH_INFO: `/v3/users/4f154cea1d464cddb1a6854bcfe51c3d` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:25.037116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f154cea1d464cddb1a6854bcfe51c3d)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:25.039164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:25.308483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f154cea1d464cddb1a6854bcfe51c3d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:25.321227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f154cea1d464cddb1a6854bcfe51c3d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:25.322019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f154cea1d464cddb1a6854bcfe51c3d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:25.324740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f154cea1d464cddb1a6854bcfe51c3d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:25.456017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-8c7c6fb0-db12-4a41-8a0c-0b2ea30da8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f154cea1d464cddb1a6854bcfe51c3d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:25.470897 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1145/2304] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:09:24 2022] DELETE /identity/v3/users/4f154cea1d464cddb1a6854bcfe51c3d => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:25.889680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:25.891205 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:25.906218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225124d3-fecc-4a2a-a82f-f1da64d4dc99 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:25.966292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:25.967150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:25.967435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:25.967712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] PATH_INFO: `/v3/projects/785ed8c8950d431c994b3ee80a55f736` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:25.968893 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=785ed8c8950d431c994b3ee80a55f736)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:25.970837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:26.089429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785ed8c8950d431c994b3ee80a55f736', 'request_id': 'req-b2c9f106-4476-4d1a-bdd5-b1aecc382750'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:26.161393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785ed8c8950d431c994b3ee80a55f736', 'request_id': 'req-b2c9f106-4476-4d1a-bdd5-b1aecc382750'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:26.167446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785ed8c8950d431c994b3ee80a55f736', 'request_id': 'req-b2c9f106-4476-4d1a-bdd5-b1aecc382750'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:26.178901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] The token cache is being invalidate because project 785ed8c8950d431c994b3ee80a55f736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:09:26.181190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:26.181190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b2c9f106-4476-4d1a-bdd5-b1aecc382750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:26.181656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1160/2305] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:09:25 2022] DELETE /identity/v3/projects/785ed8c8950d431c994b3ee80a55f736 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:26.186899 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64798904-0dc3-4eb1-8544-eff27177c1d3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.187401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64798904-0dc3-4eb1-8544-eff27177c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.187509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64798904-0dc3-4eb1-8544-eff27177c1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.208235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-64798904-0dc3-4eb1-8544-eff27177c1d3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:26.209511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-64798904-0dc3-4eb1-8544-eff27177c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:26.269262 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1146/2306] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:26.278680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa6fab-15d5-4e85-b1dd-ac7da7aa4480 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.278974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa6fab-15d5-4e85-b1dd-ac7da7aa4480 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.279395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa6fab-15d5-4e85-b1dd-ac7da7aa4480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.297771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-15aa6fab-15d5-4e85-b1dd-ac7da7aa4480 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:26.298983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-15aa6fab-15d5-4e85-b1dd-ac7da7aa4480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:26.307370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1161/2307] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:26.312790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64798904-0dc3-4eb1-8544-eff27177c1d3 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:26.322419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64798904-0dc3-4eb1-8544-eff27177c1d3 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:26.327712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:26.328367 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.328648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.328923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.329696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:09:26.329996 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:26.331705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:26.343814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1147/2308] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:09:26.348345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa6fab-15d5-4e85-b1dd-ac7da7aa4480 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:26.358464 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa6fab-15d5-4e85-b1dd-ac7da7aa4480 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:26.363131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa556f0-09b6-4d94-91e9-ec83a1bc1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:26.363771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa556f0-09b6-4d94-91e9-ec83a1bc1a10 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.364050 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa556f0-09b6-4d94-91e9-ec83a1bc1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.364321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa556f0-09b6-4d94-91e9-ec83a1bc1a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.365005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa556f0-09b6-4d94-91e9-ec83a1bc1a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:26.366977 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa556f0-09b6-4d94-91e9-ec83a1bc1a10 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:26.545918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1162/2309] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:09:26 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:26.550154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:26.561073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f3ec0-cec8-4e25-b7cc-98821ce7de1e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:26.616460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e7a7b-567d-4c5b-9b06-5b17c18a32f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:26.617095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7a7b-567d-4c5b-9b06-5b17c18a32f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.617419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7a7b-567d-4c5b-9b06-5b17c18a32f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.617701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7a7b-567d-4c5b-9b06-5b17c18a32f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.618424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e7a7b-567d-4c5b-9b06-5b17c18a32f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:26.621063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e7a7b-567d-4c5b-9b06-5b17c18a32f0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:26.751511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1148/2310] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:09:26 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:26.756434 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa556f0-09b6-4d94-91e9-ec83a1bc1a10 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:26.767611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa556f0-09b6-4d94-91e9-ec83a1bc1a10 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:26.772204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f9eef-e338-4b32-ac35-8b9608d52804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:26.772863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9eef-e338-4b32-ac35-8b9608d52804 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.773149 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9eef-e338-4b32-ac35-8b9608d52804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.773458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9eef-e338-4b32-ac35-8b9608d52804 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.774193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f9eef-e338-4b32-ac35-8b9608d52804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:26.775815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f9eef-e338-4b32-ac35-8b9608d52804 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:26.786333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1163/2311] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:09:26.790551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e7a7b-567d-4c5b-9b06-5b17c18a32f0 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:26.800970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e7a7b-567d-4c5b-9b06-5b17c18a32f0 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:26.805542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6697f-9dc6-49c5-954b-317ad421ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:26.806204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6697f-9dc6-49c5-954b-317ad421ed60 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.806489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6697f-9dc6-49c5-954b-317ad421ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.806770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6697f-9dc6-49c5-954b-317ad421ed60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.807503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6697f-9dc6-49c5-954b-317ad421ed60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:26.809883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6697f-9dc6-49c5-954b-317ad421ed60 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:26.820445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1149/2312] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:26.826144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f9eef-e338-4b32-ac35-8b9608d52804 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:26.836378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f9eef-e338-4b32-ac35-8b9608d52804 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:26.841108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:26.842058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.842339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.842618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] PATH_INFO: `/v3/projects/a02d13ffc57b4fef80f0606fbe5b1024/users/144cd5ef8ec34571b4d4fdea84d3dc33/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.857618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02d13ffc57b4fef80f0606fbe5b1024, user_id=144cd5ef8ec34571b4d4fdea84d3dc33, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:26.860344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:26.925286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1164/2313] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:26 2022] PUT /identity/v3/projects/a02d13ffc57b4fef80f0606fbe5b1024/users/144cd5ef8ec34571b4d4fdea84d3dc33/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:26.930935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67579e-39e3-4427-b6e2-dc1519b7fb3d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:26.931265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67579e-39e3-4427-b6e2-dc1519b7fb3d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:26.931612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67579e-39e3-4427-b6e2-dc1519b7fb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:26.951251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-bd67579e-39e3-4427-b6e2-dc1519b7fb3d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:26.955151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bd67579e-39e3-4427-b6e2-dc1519b7fb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:27.014263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1150/2314] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:27.024427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:27.026238 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:27.083842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78839d5-a223-417a-b1c4-62feb57e1686 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:27.087525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4dbf-1b17-4ef6-af3e-d05c10a9ec50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:27.088162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4dbf-1b17-4ef6-af3e-d05c10a9ec50 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:27.088447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4dbf-1b17-4ef6-af3e-d05c10a9ec50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:27.088778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4dbf-1b17-4ef6-af3e-d05c10a9ec50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:27.098122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4dbf-1b17-4ef6-af3e-d05c10a9ec50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:27.099551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4dbf-1b17-4ef6-af3e-d05c10a9ec50 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:27.109825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1165/2315] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:28.788638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfe125-5f3d-410f-8761-194fbf3c75f9 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:28.789214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfe125-5f3d-410f-8761-194fbf3c75f9 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:28.789214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfe125-5f3d-410f-8761-194fbf3c75f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:28.817583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-fabfe125-5f3d-410f-8761-194fbf3c75f9 None None] MFA Rules not processed for user `144cd5ef8ec34571b4d4fdea84d3dc33`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:28.818717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-fabfe125-5f3d-410f-8761-194fbf3c75f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:28.888970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1151/2316] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:28.893788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4dbf-1b17-4ef6-af3e-d05c10a9ec50 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:28.905472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4dbf-1b17-4ef6-af3e-d05c10a9ec50 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:28.910637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0542-488a-4b28-b18b-2c29c1dea48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:28.911306 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0542-488a-4b28-b18b-2c29c1dea48e admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:28.911590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0542-488a-4b28-b18b-2c29c1dea48e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:28.911868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0542-488a-4b28-b18b-2c29c1dea48e admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:28.912561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a0542-488a-4b28-b18b-2c29c1dea48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:28.915181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a0542-488a-4b28-b18b-2c29c1dea48e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:28.994067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1166/2317] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:09:28 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:28.999374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfe125-5f3d-410f-8761-194fbf3c75f9 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:29.012435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfe125-5f3d-410f-8761-194fbf3c75f9 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:29.071834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e68fb4-6226-4f50-81f5-02d45fa20ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:29.072432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68fb4-6226-4f50-81f5-02d45fa20ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:29.072747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68fb4-6226-4f50-81f5-02d45fa20ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:29.073024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68fb4-6226-4f50-81f5-02d45fa20ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:29.074437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e68fb4-6226-4f50-81f5-02d45fa20ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:29.076354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e68fb4-6226-4f50-81f5-02d45fa20ae2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:29.193696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1152/2318] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:09:28 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:09:29.195433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0542-488a-4b28-b18b-2c29c1dea48e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:29.208437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0542-488a-4b28-b18b-2c29c1dea48e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:29.213042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b2be8-eb18-4b7d-9b32-3ec6372e9a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:29.213749 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2be8-eb18-4b7d-9b32-3ec6372e9a79 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:29.214017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2be8-eb18-4b7d-9b32-3ec6372e9a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:29.214331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b2be8-eb18-4b7d-9b32-3ec6372e9a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:29.215064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2be8-eb18-4b7d-9b32-3ec6372e9a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:29.216714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b2be8-eb18-4b7d-9b32-3ec6372e9a79 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:29.227419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1167/2319] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:29.232234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e68fb4-6226-4f50-81f5-02d45fa20ae2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:29.243371 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e68fb4-6226-4f50-81f5-02d45fa20ae2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:29.250412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dff18-f66e-4fb8-822c-39bb6feeaa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:29.251303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dff18-f66e-4fb8-822c-39bb6feeaa4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:29.251580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dff18-f66e-4fb8-822c-39bb6feeaa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:29.251855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dff18-f66e-4fb8-822c-39bb6feeaa4e admin admin] PATH_INFO: `/v3/projects/00c52bd662f840e1bcdbfd9f6d924509/users/0a2f5db494b743d2a380064ef1d01e93/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:29.267867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818dff18-f66e-4fb8-822c-39bb6feeaa4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c52bd662f840e1bcdbfd9f6d924509, user_id=0a2f5db494b743d2a380064ef1d01e93, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:29.270586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818dff18-f66e-4fb8-822c-39bb6feeaa4e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:29.368228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1153/2320] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:29 2022] PUT /identity/v3/projects/00c52bd662f840e1bcdbfd9f6d924509/users/0a2f5db494b743d2a380064ef1d01e93/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:29.372807 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b2be8-eb18-4b7d-9b32-3ec6372e9a79 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:29.383029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b2be8-eb18-4b7d-9b32-3ec6372e9a79 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:29.439792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b152-ae18-4491-9b34-3857252a2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:29.440462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b152-ae18-4491-9b34-3857252a2cbf admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:29.440744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b152-ae18-4491-9b34-3857252a2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:29.441028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b152-ae18-4491-9b34-3857252a2cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:29.441795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b152-ae18-4491-9b34-3857252a2cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:29.443400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b152-ae18-4491-9b34-3857252a2cbf admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:29.454136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1168/2321] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:29.458321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dff18-f66e-4fb8-822c-39bb6feeaa4e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:29.469223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dff18-f66e-4fb8-822c-39bb6feeaa4e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:29.473912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:29.474837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:29.475064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:29.475337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] PATH_INFO: `/v3/projects/00c52bd662f840e1bcdbfd9f6d924509/users/0a2f5db494b743d2a380064ef1d01e93/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:29.477306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c52bd662f840e1bcdbfd9f6d924509, user_id=0a2f5db494b743d2a380064ef1d01e93, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:29.481416 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:29.490772 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1154/2322] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:29 2022] PUT /identity/v3/projects/00c52bd662f840e1bcdbfd9f6d924509/users/0a2f5db494b743d2a380064ef1d01e93/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:31.155901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dfd39-87cc-48c9-bf9b-7c677d68b5dd None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:31.156429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dfd39-87cc-48c9-bf9b-7c677d68b5dd None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:31.156429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dfd39-87cc-48c9-bf9b-7c677d68b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:31.187069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c20dfd39-87cc-48c9-bf9b-7c677d68b5dd None None] MFA Rules not processed for user `0a2f5db494b743d2a380064ef1d01e93`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:31.188329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c20dfd39-87cc-48c9-bf9b-7c677d68b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:31.266159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1169/2323] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:31.277835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:31.282708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:31.334889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628f8df-8386-4d69-88b2-66ec91f712c2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:31.338543 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066b8b2-580c-4dd9-99a6-9fb4834266af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:31.339767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b8b2-580c-4dd9-99a6-9fb4834266af service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:31.340082 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b8b2-580c-4dd9-99a6-9fb4834266af service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:31.340351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066b8b2-580c-4dd9-99a6-9fb4834266af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:31.397427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066b8b2-580c-4dd9-99a6-9fb4834266af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:31.398857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066b8b2-580c-4dd9-99a6-9fb4834266af service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:31.409083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1155/2324] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:33.140394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dfd39-87cc-48c9-bf9b-7c677d68b5dd None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:33.142027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c20dfd39-87cc-48c9-bf9b-7c677d68b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:33.154915 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dfd39-87cc-48c9-bf9b-7c677d68b5dd None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:33.158474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc73cf4-3207-40ba-a0d8-a0b193b127da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:33.159134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73cf4-3207-40ba-a0d8-a0b193b127da service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:33.159414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73cf4-3207-40ba-a0d8-a0b193b127da service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:33.159696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc73cf4-3207-40ba-a0d8-a0b193b127da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:33.169900 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc73cf4-3207-40ba-a0d8-a0b193b127da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:33.171331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc73cf4-3207-40ba-a0d8-a0b193b127da service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:33.181486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1170/2325] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:49.342574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066b8b2-580c-4dd9-99a6-9fb4834266af service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:49.409153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066b8b2-580c-4dd9-99a6-9fb4834266af service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:49.413785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:49.414654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:49.414941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:49.415217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] PATH_INFO: `/v3/users/144cd5ef8ec34571b4d4fdea84d3dc33` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:49.416515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144cd5ef8ec34571b4d4fdea84d3dc33)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:49.418517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:49.711840 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144cd5ef8ec34571b4d4fdea84d3dc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:49.724642 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144cd5ef8ec34571b4d4fdea84d3dc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:49.725428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144cd5ef8ec34571b4d4fdea84d3dc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:49.726159 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144cd5ef8ec34571b4d4fdea84d3dc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:49.820895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144cd5ef8ec34571b4d4fdea84d3dc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:49.834512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1156/2326] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:09:49 2022] DELETE /identity/v3/users/144cd5ef8ec34571b4d4fdea84d3dc33 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:50.122640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc73cf4-3207-40ba-a0d8-a0b193b127da service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:50.134232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc73cf4-3207-40ba-a0d8-a0b193b127da service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:50.234675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:50.236194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:50.236581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:50.237188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] PATH_INFO: `/v3/projects/a02d13ffc57b4fef80f0606fbe5b1024` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:50.238924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02d13ffc57b4fef80f0606fbe5b1024)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:50.241764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:50.402960 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02d13ffc57b4fef80f0606fbe5b1024', 'request_id': 'req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:50.469451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02d13ffc57b4fef80f0606fbe5b1024', 'request_id': 'req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:50.475615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02d13ffc57b4fef80f0606fbe5b1024', 'request_id': 'req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:50.487272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] The token cache is being invalidate because project a02d13ffc57b4fef80f0606fbe5b1024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:09:50.487559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:50.488637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:50.490452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1171/2327] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:09:50 2022] DELETE /identity/v3/projects/a02d13ffc57b4fef80f0606fbe5b1024 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:50.494453 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:50.496900 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:50.510469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3a6e2-7b7d-4f4e-a77b-1604872b7f09 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:50.568959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:50.569853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:50.570135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:50.570410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] PATH_INFO: `/v3/users/0a2f5db494b743d2a380064ef1d01e93` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:50.571600 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2f5db494b743d2a380064ef1d01e93)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:50.574076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:50.868079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2f5db494b743d2a380064ef1d01e93'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:50.880797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2f5db494b743d2a380064ef1d01e93'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:50.881819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2f5db494b743d2a380064ef1d01e93'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:50.882441 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2f5db494b743d2a380064ef1d01e93'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:51.072675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-0ecd5659-9c19-4dd8-a85b-491abf2c8cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2f5db494b743d2a380064ef1d01e93'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:51.087058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1157/2328] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:09:50 2022] DELETE /identity/v3/users/0a2f5db494b743d2a380064ef1d01e93 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:51.748021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:51.749680 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:51.769373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1a35-7160-4d19-bdd0-2249a90f11dc admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:51.846665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:51.847670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:51.848140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:51.848397 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] PATH_INFO: `/v3/projects/00c52bd662f840e1bcdbfd9f6d924509` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:51.849843 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c52bd662f840e1bcdbfd9f6d924509)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:51.852042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:51.976548 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c52bd662f840e1bcdbfd9f6d924509', 'request_id': 'req-56393c7f-2c52-4414-950f-75840e366486'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:52.095586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c52bd662f840e1bcdbfd9f6d924509', 'request_id': 'req-56393c7f-2c52-4414-950f-75840e366486'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:52.112116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c52bd662f840e1bcdbfd9f6d924509', 'request_id': 'req-56393c7f-2c52-4414-950f-75840e366486'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:52.114728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] The token cache is being invalidate because project 00c52bd662f840e1bcdbfd9f6d924509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:09:52.115323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:52.116377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-56393c7f-2c52-4414-950f-75840e366486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:52.118645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1172/2329] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:09:51 2022] DELETE /identity/v3/projects/00c52bd662f840e1bcdbfd9f6d924509 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:52.124598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dc3db-db28-4d94-8b97-60588fded10c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:52.125077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dc3db-db28-4d94-8b97-60588fded10c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:52.125181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dc3db-db28-4d94-8b97-60588fded10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:52.146729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0e7dc3db-db28-4d94-8b97-60588fded10c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:52.147944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0e7dc3db-db28-4d94-8b97-60588fded10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:52.224779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1158/2330] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:52.233146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f935364-50b9-44bd-88ec-19ff547b5d65 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:52.239326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f935364-50b9-44bd-88ec-19ff547b5d65 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:52.239326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f935364-50b9-44bd-88ec-19ff547b5d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:52.265870 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1f935364-50b9-44bd-88ec-19ff547b5d65 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:52.267538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1f935364-50b9-44bd-88ec-19ff547b5d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:52.276279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1173/2331] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:09:52.280757 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dc3db-db28-4d94-8b97-60588fded10c None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:52.292761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dc3db-db28-4d94-8b97-60588fded10c None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:52.297992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:52.298674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:52.299143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:52.299578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:52.300500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:09:52.300968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:52.302999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:52.320651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1159/2332] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:09:52.328362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f935364-50b9-44bd-88ec-19ff547b5d65 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:52.343734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f935364-50b9-44bd-88ec-19ff547b5d65 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:52.366942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6623414-5a91-465c-a2cb-969687f8eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:52.370368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623414-5a91-465c-a2cb-969687f8eb2d admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:52.370751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623414-5a91-465c-a2cb-969687f8eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:52.371038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623414-5a91-465c-a2cb-969687f8eb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:52.372549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6623414-5a91-465c-a2cb-969687f8eb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:52.394401 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6623414-5a91-465c-a2cb-969687f8eb2d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:52.530084 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1174/2333] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:09:52 2022] POST /identity/v3/projects => generated 359 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:52.534115 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:52.545412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417aa36-6306-41c9-adf3-955b24b802a0 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:52.603385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094404a-07d3-4ff0-abe6-a52d8e89aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:52.604573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094404a-07d3-4ff0-abe6-a52d8e89aac9 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:52.604981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094404a-07d3-4ff0-abe6-a52d8e89aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:52.605625 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094404a-07d3-4ff0-abe6-a52d8e89aac9 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:52.606101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094404a-07d3-4ff0-abe6-a52d8e89aac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:52.608062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094404a-07d3-4ff0-abe6-a52d8e89aac9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:52.716785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1160/2334] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:09:52 2022] POST /identity/v3/users => generated 280 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:52.718071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6623414-5a91-465c-a2cb-969687f8eb2d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:52.729871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6623414-5a91-465c-a2cb-969687f8eb2d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:52.735254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b35b7d-1e0d-41f6-b0ce-336e55ca4c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:52.735926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b35b7d-1e0d-41f6-b0ce-336e55ca4c57 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:52.736334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b35b7d-1e0d-41f6-b0ce-336e55ca4c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:52.736566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b35b7d-1e0d-41f6-b0ce-336e55ca4c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:52.737341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b35b7d-1e0d-41f6-b0ce-336e55ca4c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:52.739080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b35b7d-1e0d-41f6-b0ce-336e55ca4c57 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:52.756246 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1175/2335] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:09:52.760905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094404a-07d3-4ff0-abe6-a52d8e89aac9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:52.771232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094404a-07d3-4ff0-abe6-a52d8e89aac9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:52.776157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9d292-03e6-424b-beec-22360de420be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:52.780002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d292-03e6-424b-beec-22360de420be admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:52.780002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d292-03e6-424b-beec-22360de420be admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:52.780002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d292-03e6-424b-beec-22360de420be admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:52.780002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9d292-03e6-424b-beec-22360de420be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:52.780485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9d292-03e6-424b-beec-22360de420be admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:52.791045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1161/2336] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:52.795421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b35b7d-1e0d-41f6-b0ce-336e55ca4c57 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:52.805719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b35b7d-1e0d-41f6-b0ce-336e55ca4c57 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:52.810804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:52.811973 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:52.812423 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:52.812778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] PATH_INFO: `/v3/projects/66a1a692a17c423c96aad4258f5727de/users/23bc443882084c7680832cee2610d5e3/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:52.832949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a1a692a17c423c96aad4258f5727de, user_id=23bc443882084c7680832cee2610d5e3, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:52.836329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:53.042987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1176/2337] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:52 2022] PUT /identity/v3/projects/66a1a692a17c423c96aad4258f5727de/users/23bc443882084c7680832cee2610d5e3/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:53.053647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32384-c881-49cf-9a08-b0557603f45f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:53.055102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32384-c881-49cf-9a08-b0557603f45f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:53.055102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32384-c881-49cf-9a08-b0557603f45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:53.087788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-bbf32384-c881-49cf-9a08-b0557603f45f None None] MFA Rules not processed for user `23bc443882084c7680832cee2610d5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:53.089594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bbf32384-c881-49cf-9a08-b0557603f45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:53.181165 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1162/2338] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:53.217379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:53.219128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:53.281905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b67157-bd4d-493a-a91a-122b883f3035 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:53.285545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1d44d-5470-450b-8e72-c1f03fe4de97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:53.286183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d44d-5470-450b-8e72-c1f03fe4de97 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:53.286465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d44d-5470-450b-8e72-c1f03fe4de97 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:53.286737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d44d-5470-450b-8e72-c1f03fe4de97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:53.298137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1d44d-5470-450b-8e72-c1f03fe4de97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:53.300612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1d44d-5470-450b-8e72-c1f03fe4de97 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:53.311373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1177/2339] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:53 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:53.326499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32384-c881-49cf-9a08-b0557603f45f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:53.394874 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32384-c881-49cf-9a08-b0557603f45f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:53.399607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:53.400520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:53.400800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:53.401175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] PATH_INFO: `/v3/users/23bc443882084c7680832cee2610d5e3` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:53.402527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23bc443882084c7680832cee2610d5e3)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:53.404468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:53.658042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23bc443882084c7680832cee2610d5e3'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:53.671509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23bc443882084c7680832cee2610d5e3'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:53.672229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23bc443882084c7680832cee2610d5e3'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:53.672842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23bc443882084c7680832cee2610d5e3'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:53.806789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23bc443882084c7680832cee2610d5e3'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:53.820196 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1163/2340] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:09:53 2022] DELETE /identity/v3/users/23bc443882084c7680832cee2610d5e3 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:53.824837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd5b9e-ee41-4a2d-8764-ea04d4bd4c29 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:53.825348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd5b9e-ee41-4a2d-8764-ea04d4bd4c29 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:53.825462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd5b9e-ee41-4a2d-8764-ea04d4bd4c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:53.845017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-14bd5b9e-ee41-4a2d-8764-ea04d4bd4c29 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:53.846616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-14bd5b9e-ee41-4a2d-8764-ea04d4bd4c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:53.923447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1178/2341] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:53.933164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:53.934665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:53.997335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab828f9-4a8a-4cb7-8e73-3c230d56117f admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:54.000966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:54.001651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:54.001931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:54.002204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:54.012363 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:54.013860 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:54.024114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1164/2342] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:54.287452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357075d-5a5d-44b9-890c-312e263ae43c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:54.287736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357075d-5a5d-44b9-890c-312e263ae43c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:54.288015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357075d-5a5d-44b9-890c-312e263ae43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:54.306203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7357075d-5a5d-44b9-890c-312e263ae43c None None] MFA Rules not processed for user `4290947cee5b49dda7f75d4656d4e834`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:54.308090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7357075d-5a5d-44b9-890c-312e263ae43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:54.366068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1179/2343] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:54.504915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:54.506681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:54.522028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c23c5-f11a-499f-8653-8a0245058604 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:54.530676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:54.537439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:54.537439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:54.537439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] PATH_INFO: `/v3/projects/66a1a692a17c423c96aad4258f5727de` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:54.537439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a1a692a17c423c96aad4258f5727de)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:54.539087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:54.773489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a1a692a17c423c96aad4258f5727de', 'request_id': 'req-68a81dc7-d1d7-4efa-becf-c4798431b653'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:54.898035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a1a692a17c423c96aad4258f5727de', 'request_id': 'req-68a81dc7-d1d7-4efa-becf-c4798431b653'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:54.904632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a1a692a17c423c96aad4258f5727de', 'request_id': 'req-68a81dc7-d1d7-4efa-becf-c4798431b653'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:54.916033 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] The token cache is being invalidate because project 66a1a692a17c423c96aad4258f5727de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:09:54.916231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:54.917564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-68a81dc7-d1d7-4efa-becf-c4798431b653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:09:54.919440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1165/2344] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:09:54 2022] DELETE /identity/v3/projects/66a1a692a17c423c96aad4258f5727de => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:54.924350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a39c50-49b8-4b9e-b344-0fad7fe94b44 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:54.924858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a39c50-49b8-4b9e-b344-0fad7fe94b44 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:54.925067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a39c50-49b8-4b9e-b344-0fad7fe94b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:54.946862 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-48a39c50-49b8-4b9e-b344-0fad7fe94b44 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:54.948645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-48a39c50-49b8-4b9e-b344-0fad7fe94b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:55.012261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1180/2345] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:55.020998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6d5c-41fb-4a98-b583-25d86e61cb3f None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:55.021323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6d5c-41fb-4a98-b583-25d86e61cb3f None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:55.021609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6d5c-41fb-4a98-b583-25d86e61cb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:55.040551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-929d6d5c-41fb-4a98-b583-25d86e61cb3f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:55.042317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-929d6d5c-41fb-4a98-b583-25d86e61cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:55.050830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1166/2346] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:55.055238 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a39c50-49b8-4b9e-b344-0fad7fe94b44 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:55.066577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a39c50-49b8-4b9e-b344-0fad7fe94b44 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:55.071457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:55.072119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:55.072404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:55.072683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:55.073577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:09:55.073790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:55.075631 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:55.087765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1181/2347] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:09:55.093303 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d6d5c-41fb-4a98-b583-25d86e61cb3f None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:55.102727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d6d5c-41fb-4a98-b583-25d86e61cb3f None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:55.108074 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cfcff-7082-4ea6-a476-81d12f5a85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:55.108748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cfcff-7082-4ea6-a476-81d12f5a85c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:55.109027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cfcff-7082-4ea6-a476-81d12f5a85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:55.109643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cfcff-7082-4ea6-a476-81d12f5a85c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:55.110290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cfcff-7082-4ea6-a476-81d12f5a85c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:55.112213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cfcff-7082-4ea6-a476-81d12f5a85c9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:55.249290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1167/2348] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:09:55 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:55.253748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:55.264393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802f3e4-901f-4f77-9cd3-98d20d5aa413 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:55.325659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9aaa16-8303-44a6-900b-41632b499d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:55.326331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aaa16-8303-44a6-900b-41632b499d65 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:55.326615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aaa16-8303-44a6-900b-41632b499d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:55.326897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aaa16-8303-44a6-900b-41632b499d65 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:55.327583 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9aaa16-8303-44a6-900b-41632b499d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:55.329545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9aaa16-8303-44a6-900b-41632b499d65 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:55.544992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1182/2349] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:09:55 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:09:55.549308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cfcff-7082-4ea6-a476-81d12f5a85c9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:55.560574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cfcff-7082-4ea6-a476-81d12f5a85c9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:55.565807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53f309-8fca-45cc-985a-ccc9398e2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:55.566470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53f309-8fca-45cc-985a-ccc9398e2b8d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:55.566755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53f309-8fca-45cc-985a-ccc9398e2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:55.567033 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53f309-8fca-45cc-985a-ccc9398e2b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:55.568086 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53f309-8fca-45cc-985a-ccc9398e2b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:55.576312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53f309-8fca-45cc-985a-ccc9398e2b8d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:55.582935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1168/2350] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:55.586902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9aaa16-8303-44a6-900b-41632b499d65 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:55.598316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9aaa16-8303-44a6-900b-41632b499d65 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:55.603527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a7de0-0f19-4d62-bde9-5a5e2adbfffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:55.604883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a7de0-0f19-4d62-bde9-5a5e2adbfffa admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:55.605670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a7de0-0f19-4d62-bde9-5a5e2adbfffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:55.605956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a7de0-0f19-4d62-bde9-5a5e2adbfffa admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:55.606686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a7de0-0f19-4d62-bde9-5a5e2adbfffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:55.608352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a7de0-0f19-4d62-bde9-5a5e2adbfffa admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:55.618619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1183/2351] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:09:55.623518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53f309-8fca-45cc-985a-ccc9398e2b8d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:55.633639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53f309-8fca-45cc-985a-ccc9398e2b8d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:55.639097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:55.640016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:55.640295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:55.640577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] PATH_INFO: `/v3/projects/38349c1da8f844fd8dad9dde4ae16927/users/b93cfa9034a043c4b99c6bda0df1b62d/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:55.656824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=38349c1da8f844fd8dad9dde4ae16927, user_id=b93cfa9034a043c4b99c6bda0df1b62d, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:55.659518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:55.790088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1169/2352] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:09:55 2022] PUT /identity/v3/projects/38349c1da8f844fd8dad9dde4ae16927/users/b93cfa9034a043c4b99c6bda0df1b62d/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:09:55.801274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68dc3-2e8c-4a49-9bfa-0fa2f9582bc9 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:55.801477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68dc3-2e8c-4a49-9bfa-0fa2f9582bc9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:55.801819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68dc3-2e8c-4a49-9bfa-0fa2f9582bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:55.833788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-05e68dc3-2e8c-4a49-9bfa-0fa2f9582bc9 None None] MFA Rules not processed for user `b93cfa9034a043c4b99c6bda0df1b62d`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:09:55.835225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-05e68dc3-2e8c-4a49-9bfa-0fa2f9582bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:55.919780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1184/2353] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:09:55.931740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:55.934369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:55.997319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc3cc5-333f-49cc-8f5d-5584471a21ce admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:56.001578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566fe7e-f9e0-4f7e-a4f0-72dd961f863d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:56.002296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566fe7e-f9e0-4f7e-a4f0-72dd961f863d service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:56.002541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566fe7e-f9e0-4f7e-a4f0-72dd961f863d service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:56.002897 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566fe7e-f9e0-4f7e-a4f0-72dd961f863d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:56.014494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566fe7e-f9e0-4f7e-a4f0-72dd961f863d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:56.016042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566fe7e-f9e0-4f7e-a4f0-72dd961f863d service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:56.026892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1170/2354] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:09:58.366013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e68dc3-2e8c-4a49-9bfa-0fa2f9582bc9 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:09:58.376214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e68dc3-2e8c-4a49-9bfa-0fa2f9582bc9 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:09:58.380057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:09:58.380794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:09:58.381151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:09:58.381847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:09:58.383772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:09:58.446275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:09:58.447936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:09:58.457422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1185/2355] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:09:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:10:02.274104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66305fb-9c35-4a78-89f9-057e35526500 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:02.274993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66305fb-9c35-4a78-89f9-057e35526500 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:02.275500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66305fb-9c35-4a78-89f9-057e35526500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:02.300181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d66305fb-9c35-4a78-89f9-057e35526500 None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:02.302096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d66305fb-9c35-4a78-89f9-057e35526500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:02.378141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1171/2356] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:10:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:10:02.569315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:02.572792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:02.655851 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599fc455-e5b2-4dd0-8554-65fd8af15c48 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:02.665334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadab1f4-2ee1-46b4-99ce-7cbd34a6f309 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:02.667341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab1f4-2ee1-46b4-99ce-7cbd34a6f309 service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:02.668019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab1f4-2ee1-46b4-99ce-7cbd34a6f309 service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:02.668177 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadab1f4-2ee1-46b4-99ce-7cbd34a6f309 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:02.680699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadab1f4-2ee1-46b4-99ce-7cbd34a6f309 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:02.683164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadab1f4-2ee1-46b4-99ce-7cbd34a6f309 service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:02.695014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1186/2357] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:10:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:10:23.286943 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66305fb-9c35-4a78-89f9-057e35526500 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:23.356583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66305fb-9c35-4a78-89f9-057e35526500 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:23.361174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:23.362228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:23.362664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:23.362940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] PATH_INFO: `/v3/users/b93cfa9034a043c4b99c6bda0df1b62d` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:23.364135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93cfa9034a043c4b99c6bda0df1b62d)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:23.366199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:23.602584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93cfa9034a043c4b99c6bda0df1b62d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:23.618967 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93cfa9034a043c4b99c6bda0df1b62d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:23.619808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93cfa9034a043c4b99c6bda0df1b62d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:23.620643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93cfa9034a043c4b99c6bda0df1b62d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:23.715288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93cfa9034a043c4b99c6bda0df1b62d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:23.728336 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1172/2358] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:10:23 2022] DELETE /identity/v3/users/b93cfa9034a043c4b99c6bda0df1b62d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:10:23.733606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2647d2-ce26-4b87-9bf6-6a47a9a58e79 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:23.734139 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2647d2-ce26-4b87-9bf6-6a47a9a58e79 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:23.734248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2647d2-ce26-4b87-9bf6-6a47a9a58e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:23.755416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-df2647d2-ce26-4b87-9bf6-6a47a9a58e79 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:23.756645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-df2647d2-ce26-4b87-9bf6-6a47a9a58e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:23.817709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1187/2359] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:23.829106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:23.830576 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:23.907388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef55d-3145-401e-be62-31a51256d823 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:23.911783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d6fc0-8d1d-46f5-878d-2c85c211ae3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:23.913932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6fc0-8d1d-46f5-878d-2c85c211ae3e service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:23.913932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6fc0-8d1d-46f5-878d-2c85c211ae3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:23.913932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d6fc0-8d1d-46f5-878d-2c85c211ae3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:23.924493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d6fc0-8d1d-46f5-878d-2c85c211ae3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:23.925987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d6fc0-8d1d-46f5-878d-2c85c211ae3e service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:23.937489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1173/2360] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:10:23.945955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdeed-d91d-469f-9623-26effda57829 None None] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:23.948738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdeed-d91d-469f-9623-26effda57829 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:23.948738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdeed-d91d-469f-9623-26effda57829 None None] PATH_INFO: `/` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:23.949325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1188/2361] 10.222.0.69 () {54 vars in 921 bytes} [Wed May 4 14:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 14:10:23.955031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a5779-be88-4e31-83ca-785f7e0d5b40 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:23.955325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a5779-be88-4e31-83ca-785f7e0d5b40 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:23.955605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a5779-be88-4e31-83ca-785f7e0d5b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:23.974748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-120a5779-be88-4e31-83ca-785f7e0d5b40 None None] MFA Rules not processed for user `f6da21ec482e47399411baa3c33f4f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:23.976095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-120a5779-be88-4e31-83ca-785f7e0d5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:24.066244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1174/2362] 10.222.0.69 () {58 vars in 1018 bytes} [Wed May 4 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:24.087746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbdeed-d91d-469f-9623-26effda57829 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:24.089829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-52cbdeed-d91d-469f-9623-26effda57829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:24.159339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbdeed-d91d-469f-9623-26effda57829 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:24.163510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4f77-eabd-452b-8b9e-64149b9a2f07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d96159b7fb49c08b1f5c014d26f79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:24.164262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4f77-eabd-452b-8b9e-64149b9a2f07 service glance] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:24.164614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4f77-eabd-452b-8b9e-64149b9a2f07 service glance] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:24.164900 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4f77-eabd-452b-8b9e-64149b9a2f07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:24.183654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4f77-eabd-452b-8b9e-64149b9a2f07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:24.186317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c4f77-eabd-452b-8b9e-64149b9a2f07 service glance] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:24.201753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1189/2363] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:10:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:10:24.642229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a5779-be88-4e31-83ca-785f7e0d5b40 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:24.647183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-120a5779-be88-4e31-83ca-785f7e0d5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:24.678477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a5779-be88-4e31-83ca-785f7e0d5b40 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:24.681317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:24.683157 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:24.683535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:24.683905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] PATH_INFO: `/v3/projects/38349c1da8f844fd8dad9dde4ae16927` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:24.685469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38349c1da8f844fd8dad9dde4ae16927)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:24.687656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:24.848066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38349c1da8f844fd8dad9dde4ae16927', 'request_id': 'req-23ebdbf6-a9a7-410d-99b1-1646d43c2615'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:24.946288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38349c1da8f844fd8dad9dde4ae16927', 'request_id': 'req-23ebdbf6-a9a7-410d-99b1-1646d43c2615'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:24.961147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38349c1da8f844fd8dad9dde4ae16927', 'request_id': 'req-23ebdbf6-a9a7-410d-99b1-1646d43c2615'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:24.971124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] The token cache is being invalidate because project 38349c1da8f844fd8dad9dde4ae16927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:10:24.971430 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:24.972126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23ebdbf6-a9a7-410d-99b1-1646d43c2615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:24.978095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1175/2364] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:10:24 2022] DELETE /identity/v3/projects/38349c1da8f844fd8dad9dde4ae16927 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:10:24.980597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea664-06df-4fe6-9a09-24cd6b94ca49 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:24.981080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea664-06df-4fe6-9a09-24cd6b94ca49 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:24.981177 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea664-06df-4fe6-9a09-24cd6b94ca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.005217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-552ea664-06df-4fe6-9a09-24cd6b94ca49 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:25.006466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-552ea664-06df-4fe6-9a09-24cd6b94ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:25.095202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1190/2365] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:25.102828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3741c-4fc1-47b7-9fdf-4cbec1eac720 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:25.103374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3741c-4fc1-47b7-9fdf-4cbec1eac720 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:25.104325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3741c-4fc1-47b7-9fdf-4cbec1eac720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.129341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-abe3741c-4fc1-47b7-9fdf-4cbec1eac720 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:25.130670 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-abe3741c-4fc1-47b7-9fdf-4cbec1eac720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:25.146884 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1176/2366] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:25.151705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ea664-06df-4fe6-9a09-24cd6b94ca49 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:25.174679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ea664-06df-4fe6-9a09-24cd6b94ca49 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:25.179932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:25.180613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:25.180887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:25.181164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.182697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:10:25.183227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:25.185253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:25.205365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1191/2367] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:10:25.209071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3741c-4fc1-47b7-9fdf-4cbec1eac720 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:25.218932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3741c-4fc1-47b7-9fdf-4cbec1eac720 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:25.224567 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44927a0d-3f01-459b-ae6d-cd58b1ce5e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:25.232383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44927a0d-3f01-459b-ae6d-cd58b1ce5e76 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:25.232383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44927a0d-3f01-459b-ae6d-cd58b1ce5e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:25.232383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44927a0d-3f01-459b-ae6d-cd58b1ce5e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.232383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44927a0d-3f01-459b-ae6d-cd58b1ce5e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:25.232383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44927a0d-3f01-459b-ae6d-cd58b1ce5e76 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:25.370039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1177/2368] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:10:25 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:10:25.374471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:25.386127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3240225-44d0-4be5-a574-44d5c44d738e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:25.471004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236185ae-5d81-46b6-8bca-3cd9aaa1516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:25.472482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236185ae-5d81-46b6-8bca-3cd9aaa1516e admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:25.472482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236185ae-5d81-46b6-8bca-3cd9aaa1516e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:25.472482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236185ae-5d81-46b6-8bca-3cd9aaa1516e admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.473207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236185ae-5d81-46b6-8bca-3cd9aaa1516e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:25.475188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236185ae-5d81-46b6-8bca-3cd9aaa1516e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:25.608126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1192/2369] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:10:25 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:10:25.612438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44927a0d-3f01-459b-ae6d-cd58b1ce5e76 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:25.626499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44927a0d-3f01-459b-ae6d-cd58b1ce5e76 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:25.633126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc817-a118-479f-b317-b5c15e124aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:25.634164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc817-a118-479f-b317-b5c15e124aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:25.634486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc817-a118-479f-b317-b5c15e124aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:25.635360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc817-a118-479f-b317-b5c15e124aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.636239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bc817-a118-479f-b317-b5c15e124aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:25.638063 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bc817-a118-479f-b317-b5c15e124aa3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:25.654392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1178/2370] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:10:25.655287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236185ae-5d81-46b6-8bca-3cd9aaa1516e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:25.667211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236185ae-5d81-46b6-8bca-3cd9aaa1516e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:25.672199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54f477-dcd5-46fe-b605-cab5b92421e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:25.672805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54f477-dcd5-46fe-b605-cab5b92421e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:25.673295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54f477-dcd5-46fe-b605-cab5b92421e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:25.673619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54f477-dcd5-46fe-b605-cab5b92421e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.674362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54f477-dcd5-46fe-b605-cab5b92421e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:25.676248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54f477-dcd5-46fe-b605-cab5b92421e0 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:25.689424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1193/2371] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:10:25.692505 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc817-a118-479f-b317-b5c15e124aa3 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:25.704420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc817-a118-479f-b317-b5c15e124aa3 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:25.714703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:25.715779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:25.716160 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:25.716634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] PATH_INFO: `/v3/projects/6ba6ec522648486a8429ada20d65b933/users/15d622c0608442b0b24cceddb6a2337e/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.732383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba6ec522648486a8429ada20d65b933, user_id=15d622c0608442b0b24cceddb6a2337e, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:25.735213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:25.890684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1179/2372] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:10:25 2022] PUT /identity/v3/projects/6ba6ec522648486a8429ada20d65b933/users/15d622c0608442b0b24cceddb6a2337e/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:10:25.902303 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a75b-b48b-4754-b5c6-5a5d45ef7e57 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:25.902600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a75b-b48b-4754-b5c6-5a5d45ef7e57 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:25.903511 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a75b-b48b-4754-b5c6-5a5d45ef7e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:25.933017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c899a75b-b48b-4754-b5c6-5a5d45ef7e57 None None] MFA Rules not processed for user `15d622c0608442b0b24cceddb6a2337e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:25.934344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c899a75b-b48b-4754-b5c6-5a5d45ef7e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:26.013872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1194/2373] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:26.024390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:26.026903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:26.094686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2888-7560-472c-96a5-0e212501ba05 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:26.098656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:26.099393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:26.099761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:26.100040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:26.109035 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:26.110716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:26.120489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1180/2374] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:10:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:10:29.346178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665a170-c7f1-49a9-8aa8-ca1cc3f9229f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:29.346178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665a170-c7f1-49a9-8aa8-ca1cc3f9229f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:29.346178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665a170-c7f1-49a9-8aa8-ca1cc3f9229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:29.362865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8665a170-c7f1-49a9-8aa8-ca1cc3f9229f None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:29.364103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8665a170-c7f1-49a9-8aa8-ca1cc3f9229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:29.431818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1195/2375] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:10:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:29.446569 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:29.449773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:29.539637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acb6a3-6f1d-4625-928a-992a1715ceb2 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:29.544906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a8c57-2cee-493f-9959-d92cd29b7af9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:29.545593 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a8c57-2cee-493f-9959-d92cd29b7af9 service swift] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:29.545881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a8c57-2cee-493f-9959-d92cd29b7af9 service swift] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:29.546161 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a8c57-2cee-493f-9959-d92cd29b7af9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:29.554780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a8c57-2cee-493f-9959-d92cd29b7af9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:29.556659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a8c57-2cee-493f-9959-d92cd29b7af9 service swift] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:29.565664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1181/2376] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:10:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:10:31.894388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c890-12e2-4d7c-9337-0457bf3fd9d6 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:31.894989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c890-12e2-4d7c-9337-0457bf3fd9d6 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:31.894989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3c890-12e2-4d7c-9337-0457bf3fd9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:31.913982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a6d3c890-12e2-4d7c-9337-0457bf3fd9d6 None None] MFA Rules not processed for user `5987014231084f679a795a88f14ad02e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:31.915224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a6d3c890-12e2-4d7c-9337-0457bf3fd9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:31.974722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1196/2377] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:47.035801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a8c57-2cee-493f-9959-d92cd29b7af9 service swift] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:47.142641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a8c57-2cee-493f-9959-d92cd29b7af9 service swift] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:47.148145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:47.149523 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:47.149895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:47.150273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] PATH_INFO: `/v3/users/15d622c0608442b0b24cceddb6a2337e` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:47.151948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d622c0608442b0b24cceddb6a2337e)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:47.154124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:47.448276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d622c0608442b0b24cceddb6a2337e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:47.464077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d622c0608442b0b24cceddb6a2337e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:47.464946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d622c0608442b0b24cceddb6a2337e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:47.465719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d622c0608442b0b24cceddb6a2337e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:47.615810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d622c0608442b0b24cceddb6a2337e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:47.636596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1182/2378] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:10:47 2022] DELETE /identity/v3/users/15d622c0608442b0b24cceddb6a2337e => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:10:47.642121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee90da2-b2ac-46bd-a9a7-47bb764ef35f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:47.642808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee90da2-b2ac-46bd-a9a7-47bb764ef35f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:47.642808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee90da2-b2ac-46bd-a9a7-47bb764ef35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:47.666635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-dee90da2-b2ac-46bd-a9a7-47bb764ef35f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:47.670587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-dee90da2-b2ac-46bd-a9a7-47bb764ef35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:47.789882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1197/2379] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:47.805951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:47.810066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:47.915316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c400-671b-42a2-b551-fcd7ebf4c6be admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:47.937220 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24af6a-0ab0-4c14-90ce-3d9984023d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:47.942913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24af6a-0ab0-4c14-90ce-3d9984023d27 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:47.943208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24af6a-0ab0-4c14-90ce-3d9984023d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:47.943492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24af6a-0ab0-4c14-90ce-3d9984023d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:47.974726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24af6a-0ab0-4c14-90ce-3d9984023d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:47.977265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24af6a-0ab0-4c14-90ce-3d9984023d27 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:47.989213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1183/2380] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:10:48.758881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee90da2-b2ac-46bd-a9a7-47bb764ef35f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:48.761275 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-dee90da2-b2ac-46bd-a9a7-47bb764ef35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:48.776642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee90da2-b2ac-46bd-a9a7-47bb764ef35f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:48.782566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:48.783593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:48.784278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:48.784278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] PATH_INFO: `/v3/projects/6ba6ec522648486a8429ada20d65b933` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:48.785739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba6ec522648486a8429ada20d65b933)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:48.788085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:48.929768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba6ec522648486a8429ada20d65b933', 'request_id': 'req-7c6bd44e-7411-405f-ba7d-4dc098fcd366'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:48.989771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba6ec522648486a8429ada20d65b933', 'request_id': 'req-7c6bd44e-7411-405f-ba7d-4dc098fcd366'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:48.998863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba6ec522648486a8429ada20d65b933', 'request_id': 'req-7c6bd44e-7411-405f-ba7d-4dc098fcd366'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:49.012831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] The token cache is being invalidate because project 6ba6ec522648486a8429ada20d65b933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:10:49.013369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:49.014035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c6bd44e-7411-405f-ba7d-4dc098fcd366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:10:49.018833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1198/2381] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:10:48 2022] DELETE /identity/v3/projects/6ba6ec522648486a8429ada20d65b933 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:10:49.022142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a367-24f0-4965-8691-96f92367fd1b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.023349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a367-24f0-4965-8691-96f92367fd1b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.023504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a367-24f0-4965-8691-96f92367fd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.047592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e171a367-24f0-4965-8691-96f92367fd1b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:49.049107 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e171a367-24f0-4965-8691-96f92367fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:49.111588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1184/2382] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:49.119427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b5f8e-86b7-4a42-8c08-873b582c0cd2 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.119714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b5f8e-86b7-4a42-8c08-873b582c0cd2 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.120081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b5f8e-86b7-4a42-8c08-873b582c0cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.138846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-911b5f8e-86b7-4a42-8c08-873b582c0cd2 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:49.140074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-911b5f8e-86b7-4a42-8c08-873b582c0cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:49.148634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1199/2383] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:49.154191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a367-24f0-4965-8691-96f92367fd1b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:49.163896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a367-24f0-4965-8691-96f92367fd1b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:49.169423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:49.170091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.170375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.170655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.171387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:10:49.171695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:49.173315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:49.189184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1185/2384] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:10:49.190616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b5f8e-86b7-4a42-8c08-873b582c0cd2 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:49.200147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b5f8e-86b7-4a42-8c08-873b582c0cd2 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:49.205091 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092a70d-1334-4253-a7df-7353a6ca4c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:49.205791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092a70d-1334-4253-a7df-7353a6ca4c64 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.206075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092a70d-1334-4253-a7df-7353a6ca4c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.206354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092a70d-1334-4253-a7df-7353a6ca4c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.207113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092a70d-1334-4253-a7df-7353a6ca4c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:49.209018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092a70d-1334-4253-a7df-7353a6ca4c64 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:49.314041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1200/2385] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:10:49 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:10:49.318311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:49.330627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54251c4a-0c03-447f-ab73-5773c96b5566 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:49.399170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c170539-2530-4395-b756-ec8885cccdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:49.399860 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170539-2530-4395-b756-ec8885cccdfe admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.401015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170539-2530-4395-b756-ec8885cccdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.401258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c170539-2530-4395-b756-ec8885cccdfe admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.401988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c170539-2530-4395-b756-ec8885cccdfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:49.403944 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c170539-2530-4395-b756-ec8885cccdfe admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:49.528112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1186/2386] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:10:49 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:10:49.532622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092a70d-1334-4253-a7df-7353a6ca4c64 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:49.543564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092a70d-1334-4253-a7df-7353a6ca4c64 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:49.553424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f01b-6c2c-4fe6-9135-b866ef0d695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:49.553424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f01b-6c2c-4fe6-9135-b866ef0d695b admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.553424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f01b-6c2c-4fe6-9135-b866ef0d695b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.553424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f01b-6c2c-4fe6-9135-b866ef0d695b admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.553885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f01b-6c2c-4fe6-9135-b866ef0d695b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:49.553885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f01b-6c2c-4fe6-9135-b866ef0d695b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:49.564675 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1201/2387] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:10:49.568782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c170539-2530-4395-b756-ec8885cccdfe admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:49.580461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c170539-2530-4395-b756-ec8885cccdfe admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:49.585681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abd16d-1485-401d-9ecf-ac7402de8819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:49.586388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd16d-1485-401d-9ecf-ac7402de8819 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.586674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd16d-1485-401d-9ecf-ac7402de8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.586955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd16d-1485-401d-9ecf-ac7402de8819 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.588551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abd16d-1485-401d-9ecf-ac7402de8819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:49.590232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abd16d-1485-401d-9ecf-ac7402de8819 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:49.603117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1187/2388] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:10:49.609023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f01b-6c2c-4fe6-9135-b866ef0d695b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:49.621073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f01b-6c2c-4fe6-9135-b866ef0d695b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:49.626371 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f4d60-3e37-4523-88ac-da7a2445c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:49.627279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4d60-3e37-4523-88ac-da7a2445c119 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.627751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4d60-3e37-4523-88ac-da7a2445c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.628038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4d60-3e37-4523-88ac-da7a2445c119 admin admin] PATH_INFO: `/v3/projects/4e3df9d7b8b4443aabe77cf4a5e4b549/users/bc34505203634f36af6ef486b5ac598d/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.648931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f4d60-3e37-4523-88ac-da7a2445c119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3df9d7b8b4443aabe77cf4a5e4b549, user_id=bc34505203634f36af6ef486b5ac598d, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:49.653516 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f4d60-3e37-4523-88ac-da7a2445c119 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:49.756890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1202/2389] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:10:49 2022] PUT /identity/v3/projects/4e3df9d7b8b4443aabe77cf4a5e4b549/users/bc34505203634f36af6ef486b5ac598d/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:10:49.764069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61e30c-35bc-4c48-9c1c-995cfc6fda09 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.764364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61e30c-35bc-4c48-9c1c-995cfc6fda09 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.764706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61e30c-35bc-4c48-9c1c-995cfc6fda09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.788987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-1f61e30c-35bc-4c48-9c1c-995cfc6fda09 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:49.790435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1f61e30c-35bc-4c48-9c1c-995cfc6fda09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:49.817314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3cafa-7f60-44dc-8dc1-fb57d9895eab None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:49.817863 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3cafa-7f60-44dc-8dc1-fb57d9895eab None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:49.818224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3cafa-7f60-44dc-8dc1-fb57d9895eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:49.840333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ccb3cafa-7f60-44dc-8dc1-fb57d9895eab None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:49.841419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ccb3cafa-7f60-44dc-8dc1-fb57d9895eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:49.879104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1188/2390] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:49.893064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61e30c-35bc-4c48-9c1c-995cfc6fda09 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:49.893988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1f61e30c-35bc-4c48-9c1c-995cfc6fda09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:49.924476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1203/2391] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:49.942049 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3cafa-7f60-44dc-8dc1-fb57d9895eab None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:49.944081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ccb3cafa-7f60-44dc-8dc1-fb57d9895eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:50.003948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61e30c-35bc-4c48-9c1c-995cfc6fda09 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:50.007973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a204-679c-4e2b-bef3-d5d516c3f8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:50.008617 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a204-679c-4e2b-bef3-d5d516c3f8af service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:50.008904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a204-679c-4e2b-bef3-d5d516c3f8af service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:50.009252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a204-679c-4e2b-bef3-d5d516c3f8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:50.020114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381a204-679c-4e2b-bef3-d5d516c3f8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:50.021598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381a204-679c-4e2b-bef3-d5d516c3f8af service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:50.032405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1189/2392] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:10:50.038678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3cafa-7f60-44dc-8dc1-fb57d9895eab None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:50.049111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c40d-a06a-49a0-a730-e0caf2ec378f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:50.049939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c40d-a06a-49a0-a730-e0caf2ec378f service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:50.050983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c40d-a06a-49a0-a730-e0caf2ec378f service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:50.051365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c40d-a06a-49a0-a730-e0caf2ec378f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:50.062982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378c40d-a06a-49a0-a730-e0caf2ec378f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:50.087582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378c40d-a06a-49a0-a730-e0caf2ec378f service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:50.087582 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1204/2393] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:10:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:10:57.533565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e90951-caee-4b61-ba02-e5150ad46451 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:57.534475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e90951-caee-4b61-ba02-e5150ad46451 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:57.535000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e90951-caee-4b61-ba02-e5150ad46451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:57.576054 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-d8e90951-caee-4b61-ba02-e5150ad46451 None None] MFA Rules not processed for user `bc34505203634f36af6ef486b5ac598d`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:10:57.577365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d8e90951-caee-4b61-ba02-e5150ad46451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:57.649585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1190/2394] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:10:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:10:57.654821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c40d-a06a-49a0-a730-e0caf2ec378f service swift] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:57.668718 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c40d-a06a-49a0-a730-e0caf2ec378f service swift] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:57.671748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e90951-caee-4b61-ba02-e5150ad46451 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:57.671947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ffb05-cace-4aa1-9437-6547fd11a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:57.672599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffb05-cace-4aa1-9437-6547fd11a086 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:57.672885 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffb05-cace-4aa1-9437-6547fd11a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:57.673162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffb05-cace-4aa1-9437-6547fd11a086 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:57.673899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ffb05-cace-4aa1-9437-6547fd11a086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:57.676102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ffb05-cace-4aa1-9437-6547fd11a086 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:57.681582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e90951-caee-4b61-ba02-e5150ad46451 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:57.685266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:57.685971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:57.686216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:57.686520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:57.689572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:10:57.757972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:57.759980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:57.771512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1191/2395] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:10:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:10:57.800181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1205/2396] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:10:57 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:10:57.804458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:57.816696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224072b-a081-4896-b95c-0e731d736073 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:57.912727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae054dc-b9ee-418b-b82b-3071a5fdf0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:57.913771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae054dc-b9ee-418b-b82b-3071a5fdf0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:57.914229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae054dc-b9ee-418b-b82b-3071a5fdf0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:57.914674 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae054dc-b9ee-418b-b82b-3071a5fdf0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:57.916909 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae054dc-b9ee-418b-b82b-3071a5fdf0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:57.919117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae054dc-b9ee-418b-b82b-3071a5fdf0e0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:58.059570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1192/2397] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:10:57 2022] POST /identity/v3/users => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:10:58.060325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ffb05-cace-4aa1-9437-6547fd11a086 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:58.074060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ffb05-cace-4aa1-9437-6547fd11a086 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:58.082956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0ba7-8da3-4ddc-8943-4588787ac699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:58.083613 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0ba7-8da3-4ddc-8943-4588787ac699 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:58.084047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0ba7-8da3-4ddc-8943-4588787ac699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:58.084891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0ba7-8da3-4ddc-8943-4588787ac699 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:58.085645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd0ba7-8da3-4ddc-8943-4588787ac699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:58.091781 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd0ba7-8da3-4ddc-8943-4588787ac699 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:58.105531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1206/2398] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:10:58.109399 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae054dc-b9ee-418b-b82b-3071a5fdf0e0 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:58.124708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae054dc-b9ee-418b-b82b-3071a5fdf0e0 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:58.131947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0ca3e-ea7f-4599-bf9b-ce8faae7a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:58.136123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0ca3e-ea7f-4599-bf9b-ce8faae7a55b admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:58.143316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0ca3e-ea7f-4599-bf9b-ce8faae7a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:58.143316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0ca3e-ea7f-4599-bf9b-ce8faae7a55b admin admin] PATH_INFO: `/v3/projects/d392c091076e4444801a9c6d31c7d6ac/users/81f21f0bcebd4246bf3db7d524b7dd54/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:58.167111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0ca3e-ea7f-4599-bf9b-ce8faae7a55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d392c091076e4444801a9c6d31c7d6ac, user_id=81f21f0bcebd4246bf3db7d524b7dd54, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:58.175592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0ca3e-ea7f-4599-bf9b-ce8faae7a55b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:58.281966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1193/2399] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:10:58 2022] PUT /identity/v3/projects/d392c091076e4444801a9c6d31c7d6ac/users/81f21f0bcebd4246bf3db7d524b7dd54/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:10:58.283636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0ba7-8da3-4ddc-8943-4588787ac699 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:58.304483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0ba7-8da3-4ddc-8943-4588787ac699 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:58.397950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb41db-7efc-489d-a372-36d667bbc932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:58.398617 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb41db-7efc-489d-a372-36d667bbc932 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:58.398900 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb41db-7efc-489d-a372-36d667bbc932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:58.399174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb41db-7efc-489d-a372-36d667bbc932 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:58.399972 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb41db-7efc-489d-a372-36d667bbc932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:58.402104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb41db-7efc-489d-a372-36d667bbc932 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:58.412428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1207/2400] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:10:58.417575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0ca3e-ea7f-4599-bf9b-ce8faae7a55b admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:58.428192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0ca3e-ea7f-4599-bf9b-ce8faae7a55b admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:58.433018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:58.433979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:58.434191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:58.434463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] PATH_INFO: `/v3/projects/d392c091076e4444801a9c6d31c7d6ac/users/81f21f0bcebd4246bf3db7d524b7dd54/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:58.439962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d392c091076e4444801a9c6d31c7d6ac, user_id=81f21f0bcebd4246bf3db7d524b7dd54, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:10:58.440796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:10:58.455358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1194/2401] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:10:58 2022] PUT /identity/v3/projects/d392c091076e4444801a9c6d31c7d6ac/users/81f21f0bcebd4246bf3db7d524b7dd54/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:10:59.763421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb41db-7efc-489d-a372-36d667bbc932 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:10:59.859561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb41db-7efc-489d-a372-36d667bbc932 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:10:59.935630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835cabb-e556-437c-83f5-4de2d747295a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:10:59.936399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835cabb-e556-437c-83f5-4de2d747295a service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:10:59.936597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835cabb-e556-437c-83f5-4de2d747295a service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:10:59.937040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835cabb-e556-437c-83f5-4de2d747295a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:10:59.947329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8835cabb-e556-437c-83f5-4de2d747295a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:00.074348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835cabb-e556-437c-83f5-4de2d747295a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:00.086330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835cabb-e556-437c-83f5-4de2d747295a service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:00.090193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1208/2402] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:07.526023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:07.529097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:07.551186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db66218-ab6a-42f9-b108-2c767d8f3a9c admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:07.559085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:07.559773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:07.562676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:07.563181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:07.569667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:07.602223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:07.604311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:07.635346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1195/2403] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:07.886140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4190-a89e-4213-be7d-9393a3a18324 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:07.886140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4190-a89e-4213-be7d-9393a3a18324 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:07.886140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4190-a89e-4213-be7d-9393a3a18324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:07.958476 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-2cdc4190-a89e-4213-be7d-9393a3a18324 None None] MFA Rules not processed for user `81f21f0bcebd4246bf3db7d524b7dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:07.960156 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2cdc4190-a89e-4213-be7d-9393a3a18324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:08.137416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1209/2404] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:11:08.153351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:08.155022 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:08.314070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78e6af-b634-4942-a0df-23501265d03a service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:08.334026 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984b51d-16e4-4743-9c26-d452f2ccf947 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d96159b7fb49c08b1f5c014d26f79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:08.342050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b51d-16e4-4743-9c26-d452f2ccf947 service glance] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:08.345322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b51d-16e4-4743-9c26-d452f2ccf947 service glance] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:08.345322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b51d-16e4-4743-9c26-d452f2ccf947 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:08.448848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984b51d-16e4-4743-9c26-d452f2ccf947 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:08.450947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984b51d-16e4-4743-9c26-d452f2ccf947 service glance] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:08.463777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1196/2405] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:08.753442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed93ea9-cf7b-4e6e-807d-9bc85f62c99c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:08.753933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed93ea9-cf7b-4e6e-807d-9bc85f62c99c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:08.754460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed93ea9-cf7b-4e6e-807d-9bc85f62c99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:08.838985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7ed93ea9-cf7b-4e6e-807d-9bc85f62c99c None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:08.842181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7ed93ea9-cf7b-4e6e-807d-9bc85f62c99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:08.954991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1210/2406] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:11:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:08.985109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984b51d-16e4-4743-9c26-d452f2ccf947 service glance] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:09.025349 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed93ea9-cf7b-4e6e-807d-9bc85f62c99c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:09.028400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7ed93ea9-cf7b-4e6e-807d-9bc85f62c99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:09.057376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed93ea9-cf7b-4e6e-807d-9bc85f62c99c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:09.066417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:09.068459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:09.068850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:09.069547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] PATH_INFO: `/v3/users/0ca157aeabbb4f9da8475ca002dd0239` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:09.073042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca157aeabbb4f9da8475ca002dd0239)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:09.077289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:09.155250 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984b51d-16e4-4743-9c26-d452f2ccf947 service glance] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:09.164606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237fe5b-37df-4eeb-aca5-cdb592e01042 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:09.166181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237fe5b-37df-4eeb-aca5-cdb592e01042 service swift] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:09.166181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237fe5b-37df-4eeb-aca5-cdb592e01042 service swift] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:09.166181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237fe5b-37df-4eeb-aca5-cdb592e01042 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:09.178044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237fe5b-37df-4eeb-aca5-cdb592e01042 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:09.180426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237fe5b-37df-4eeb-aca5-cdb592e01042 service swift] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:09.190226 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1197/2407] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:11:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:11:09.419978 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca157aeabbb4f9da8475ca002dd0239'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:09.448072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca157aeabbb4f9da8475ca002dd0239'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:09.449127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca157aeabbb4f9da8475ca002dd0239'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:09.449993 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca157aeabbb4f9da8475ca002dd0239'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:09.544474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-f3b5c963-b62b-4c30-81bf-82f005462444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca157aeabbb4f9da8475ca002dd0239'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:09.580630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1211/2408] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:09 2022] DELETE /identity/v3/users/0ca157aeabbb4f9da8475ca002dd0239 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:11:10.122457 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237fe5b-37df-4eeb-aca5-cdb592e01042 service swift] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:10.140495 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237fe5b-37df-4eeb-aca5-cdb592e01042 service swift] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:10.254027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:10.255219 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:10.255688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:10.256138 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] PATH_INFO: `/v3/projects/a3aa6d4e6b6d4b7f99e11f5d6104fb62` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:10.258036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3aa6d4e6b6d4b7f99e11f5d6104fb62)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:10.262382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:10.465027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3aa6d4e6b6d4b7f99e11f5d6104fb62', 'request_id': 'req-ed28c245-1e3d-4acb-b5c4-056b96977efc'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:10.556825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3aa6d4e6b6d4b7f99e11f5d6104fb62', 'request_id': 'req-ed28c245-1e3d-4acb-b5c4-056b96977efc'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:10.606771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3aa6d4e6b6d4b7f99e11f5d6104fb62', 'request_id': 'req-ed28c245-1e3d-4acb-b5c4-056b96977efc'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:10.660319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] The token cache is being invalidate because project a3aa6d4e6b6d4b7f99e11f5d6104fb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:10.660946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:10.662192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ed28c245-1e3d-4acb-b5c4-056b96977efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:10.670275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1198/2409] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:10 2022] DELETE /identity/v3/projects/a3aa6d4e6b6d4b7f99e11f5d6104fb62 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:10.671196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef1ff3-5786-4788-a662-cdfc97f3445e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:10.671669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef1ff3-5786-4788-a662-cdfc97f3445e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:10.671785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef1ff3-5786-4788-a662-cdfc97f3445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:10.736385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-92ef1ff3-5786-4788-a662-cdfc97f3445e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:10.739465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-92ef1ff3-5786-4788-a662-cdfc97f3445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:10.845721 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1212/2410] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:10.864243 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602141e-5c05-427e-bff0-f5e0f11f9cbe None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:10.865867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602141e-5c05-427e-bff0-f5e0f11f9cbe None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:10.866579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602141e-5c05-427e-bff0-f5e0f11f9cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:10.901961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b602141e-5c05-427e-bff0-f5e0f11f9cbe None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:10.904816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b602141e-5c05-427e-bff0-f5e0f11f9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:10.926847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1199/2411] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:10.928821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef1ff3-5786-4788-a662-cdfc97f3445e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:11.018581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef1ff3-5786-4788-a662-cdfc97f3445e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:11.039279 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:11.040019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:11.040390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:11.040676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:11.041518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:11:11.041841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:11.043550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:11.069358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1213/2412] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:11:11.075331 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602141e-5c05-427e-bff0-f5e0f11f9cbe None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:11.091954 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602141e-5c05-427e-bff0-f5e0f11f9cbe None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:11.103577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41331b7e-9071-462b-8ee3-db95b2b7416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:11.105191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41331b7e-9071-462b-8ee3-db95b2b7416d admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:11.105807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41331b7e-9071-462b-8ee3-db95b2b7416d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:11.109937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41331b7e-9071-462b-8ee3-db95b2b7416d admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:11.110871 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41331b7e-9071-462b-8ee3-db95b2b7416d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:11.113008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41331b7e-9071-462b-8ee3-db95b2b7416d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:11.331891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1200/2413] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:11 2022] POST /identity/v3/projects => generated 369 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:11.334121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:11.351105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f671d5-0d15-4a6f-9c21-d655a027691f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:11.507267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefba428-e533-41bf-a438-5c572282912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:11.513409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefba428-e533-41bf-a438-5c572282912f admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:11.516670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefba428-e533-41bf-a438-5c572282912f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:11.516670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefba428-e533-41bf-a438-5c572282912f admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:11.516670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefba428-e533-41bf-a438-5c572282912f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:11.517106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefba428-e533-41bf-a438-5c572282912f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:11.648553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1214/2414] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:11 2022] POST /identity/v3/users => generated 285 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:11.649870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41331b7e-9071-462b-8ee3-db95b2b7416d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:11.666541 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41331b7e-9071-462b-8ee3-db95b2b7416d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:11.682824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a6881-d2f7-40af-82f0-86fdd577d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:11.683549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6881-d2f7-40af-82f0-86fdd577d15e admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:11.683825 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6881-d2f7-40af-82f0-86fdd577d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:11.684298 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6881-d2f7-40af-82f0-86fdd577d15e admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:11.685217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a6881-d2f7-40af-82f0-86fdd577d15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:11.690470 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a6881-d2f7-40af-82f0-86fdd577d15e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:11.725554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1201/2415] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:11:11.732492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefba428-e533-41bf-a438-5c572282912f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:11.774026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefba428-e533-41bf-a438-5c572282912f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:11.799563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a566f-3e39-4e3d-829f-2a4a4b79e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:11.801600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a566f-3e39-4e3d-829f-2a4a4b79e53f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:11.802081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a566f-3e39-4e3d-829f-2a4a4b79e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:11.802543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a566f-3e39-4e3d-829f-2a4a4b79e53f admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:11.803615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a566f-3e39-4e3d-829f-2a4a4b79e53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:11.808669 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a566f-3e39-4e3d-829f-2a4a4b79e53f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:11.828313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1215/2416] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:11.834483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a6881-d2f7-40af-82f0-86fdd577d15e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:11.849522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a6881-d2f7-40af-82f0-86fdd577d15e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:11.859902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4038b8-2bfe-435f-abda-da9e1bab5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:11.871664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4038b8-2bfe-435f-abda-da9e1bab5e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:11.871664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4038b8-2bfe-435f-abda-da9e1bab5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:11.871664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4038b8-2bfe-435f-abda-da9e1bab5e31 admin admin] PATH_INFO: `/v3/projects/630bfc4183bc458c97de0117d84671c9/users/abfa8cdc371947abb4e0ad931e591466/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:11.914796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4038b8-2bfe-435f-abda-da9e1bab5e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630bfc4183bc458c97de0117d84671c9, user_id=abfa8cdc371947abb4e0ad931e591466, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:11.922070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4038b8-2bfe-435f-abda-da9e1bab5e31 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:12.082878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1202/2417] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:11 2022] PUT /identity/v3/projects/630bfc4183bc458c97de0117d84671c9/users/abfa8cdc371947abb4e0ad931e591466/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:11:12.108844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b0cb8-bd01-4988-9cd2-d262c260813b None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:12.109137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b0cb8-bd01-4988-9cd2-d262c260813b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:12.109436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b0cb8-bd01-4988-9cd2-d262c260813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:12.181672 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-556b0cb8-bd01-4988-9cd2-d262c260813b None None] MFA Rules not processed for user `abfa8cdc371947abb4e0ad931e591466`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:12.182924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-556b0cb8-bd01-4988-9cd2-d262c260813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:12.366222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1216/2418] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:12.372023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4038b8-2bfe-435f-abda-da9e1bab5e31 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:12.463545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4038b8-2bfe-435f-abda-da9e1bab5e31 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:12.475904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd056-4ced-40fb-844c-2fa49def929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:12.484698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd056-4ced-40fb-844c-2fa49def929e admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:12.486870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd056-4ced-40fb-844c-2fa49def929e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:12.487285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642dd056-4ced-40fb-844c-2fa49def929e admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:12.488171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd056-4ced-40fb-844c-2fa49def929e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:12.490402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642dd056-4ced-40fb-844c-2fa49def929e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:12.611793 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1203/2419] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:12 2022] POST /identity/v3/projects => generated 369 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:12.615641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b0cb8-bd01-4988-9cd2-d262c260813b None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:12.630671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b0cb8-bd01-4988-9cd2-d262c260813b None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:12.784371 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7aeb1-b71f-4004-8675-61b4f0fa821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:12.785048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7aeb1-b71f-4004-8675-61b4f0fa821f admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:12.785535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7aeb1-b71f-4004-8675-61b4f0fa821f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:12.785997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7aeb1-b71f-4004-8675-61b4f0fa821f admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:12.791220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7aeb1-b71f-4004-8675-61b4f0fa821f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:12.809864 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7aeb1-b71f-4004-8675-61b4f0fa821f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:12.905750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1217/2420] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:12 2022] POST /identity/v3/users => generated 291 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:12.912265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd056-4ced-40fb-844c-2fa49def929e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:12.942613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642dd056-4ced-40fb-844c-2fa49def929e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:12.959889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548602-e7f7-4da1-afc5-5b79583c554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:12.961148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548602-e7f7-4da1-afc5-5b79583c554c admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:12.962036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548602-e7f7-4da1-afc5-5b79583c554c admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:12.962560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548602-e7f7-4da1-afc5-5b79583c554c admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:12.964240 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51548602-e7f7-4da1-afc5-5b79583c554c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:12.967861 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51548602-e7f7-4da1-afc5-5b79583c554c admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:13.010269 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1204/2421] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:13.011629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7aeb1-b71f-4004-8675-61b4f0fa821f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:13.022183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7aeb1-b71f-4004-8675-61b4f0fa821f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:13.028027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249b80-8311-40a5-83e9-aebdd21f357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:13.029069 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249b80-8311-40a5-83e9-aebdd21f357a admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:13.029562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249b80-8311-40a5-83e9-aebdd21f357a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:13.029930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249b80-8311-40a5-83e9-aebdd21f357a admin admin] PATH_INFO: `/v3/projects/7827098ef3564cd98ae46799d68f0c42/users/648e211954f8490d9838bff955bbea70/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:13.051061 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54249b80-8311-40a5-83e9-aebdd21f357a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7827098ef3564cd98ae46799d68f0c42, user_id=648e211954f8490d9838bff955bbea70, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:13.054309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54249b80-8311-40a5-83e9-aebdd21f357a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:13.152261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1218/2422] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:13 2022] PUT /identity/v3/projects/7827098ef3564cd98ae46799d68f0c42/users/648e211954f8490d9838bff955bbea70/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:13.159628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548602-e7f7-4da1-afc5-5b79583c554c admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:13.203171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548602-e7f7-4da1-afc5-5b79583c554c admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:13.402186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0349e-b8d4-48e6-8817-43bb3075a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:13.404290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0349e-b8d4-48e6-8817-43bb3075a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:13.405182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0349e-b8d4-48e6-8817-43bb3075a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:13.405908 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0349e-b8d4-48e6-8817-43bb3075a8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:13.407556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0349e-b8d4-48e6-8817-43bb3075a8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:13.410572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0349e-b8d4-48e6-8817-43bb3075a8fc admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:13.434522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1205/2423] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:13.439263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249b80-8311-40a5-83e9-aebdd21f357a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:13.476077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249b80-8311-40a5-83e9-aebdd21f357a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:13.504493 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:13.507116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:13.508174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:13.510136 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] PATH_INFO: `/v3/projects/7827098ef3564cd98ae46799d68f0c42/users/648e211954f8490d9838bff955bbea70/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:13.514074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7827098ef3564cd98ae46799d68f0c42, user_id=648e211954f8490d9838bff955bbea70, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:13.522822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:13.566207 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1219/2424] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:13 2022] PUT /identity/v3/projects/7827098ef3564cd98ae46799d68f0c42/users/648e211954f8490d9838bff955bbea70/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:13.579593 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d20c-eef6-4e52-af5a-c45e4157fbeb None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:13.579955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d20c-eef6-4e52-af5a-c45e4157fbeb None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:13.580173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d20c-eef6-4e52-af5a-c45e4157fbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:13.631252 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-f7a7d20c-eef6-4e52-af5a-c45e4157fbeb None None] MFA Rules not processed for user `648e211954f8490d9838bff955bbea70`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:13.637653 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f7a7d20c-eef6-4e52-af5a-c45e4157fbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:13.850787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1206/2425] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:13.868174 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:13.871480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:14.044928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d2e4c-9f0a-43b5-afaf-6e344393a21a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:14.059468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6d38d-a17d-404d-919a-d5343c519b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:14.060877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d38d-a17d-404d-919a-d5343c519b3f service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:14.061591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d38d-a17d-404d-919a-d5343c519b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:14.062579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6d38d-a17d-404d-919a-d5343c519b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:14.092919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6d38d-a17d-404d-919a-d5343c519b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:14.100133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6d38d-a17d-404d-919a-d5343c519b3f service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:14.155921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1220/2426] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:19.208783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7d20c-eef6-4e52-af5a-c45e4157fbeb None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:19.286720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7d20c-eef6-4e52-af5a-c45e4157fbeb None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:19.293969 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:19.295057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:19.295268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:19.295815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] PATH_INFO: `/v3/users/abfa8cdc371947abb4e0ad931e591466` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:19.297449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfa8cdc371947abb4e0ad931e591466)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:19.299953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:19.556735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfa8cdc371947abb4e0ad931e591466'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:19.581288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfa8cdc371947abb4e0ad931e591466'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:19.583543 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfa8cdc371947abb4e0ad931e591466'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:19.585911 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfa8cdc371947abb4e0ad931e591466'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:19.690090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfa8cdc371947abb4e0ad931e591466'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:19.723703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1207/2427] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:19 2022] DELETE /identity/v3/users/abfa8cdc371947abb4e0ad931e591466 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:19.728795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c427-637d-4d57-bc57-e47cb4b2bd97 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:19.729811 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c427-637d-4d57-bc57-e47cb4b2bd97 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:19.730266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c427-637d-4d57-bc57-e47cb4b2bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:19.771258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8026c427-637d-4d57-bc57-e47cb4b2bd97 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:19.776668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8026c427-637d-4d57-bc57-e47cb4b2bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:19.904035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1221/2428] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:19.915698 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:19.923611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:20.042815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795c815-1995-4271-abc1-d4b062661c03 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:20.048512 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:20.049286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:20.049652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:20.050202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:20.061659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:20.063378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:20.076066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1208/2429] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:20.693063 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026c427-637d-4d57-bc57-e47cb4b2bd97 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:20.697755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8026c427-637d-4d57-bc57-e47cb4b2bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:20.724208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:20.727673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:20.728182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026c427-637d-4d57-bc57-e47cb4b2bd97 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:20.737314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:20.740137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:20.740991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:20.741759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] PATH_INFO: `/v3/users/7193d40ab98640c399e88bcdc2659de6` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:20.758638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7193d40ab98640c399e88bcdc2659de6)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:20.765213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:20.781829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981ce38-914b-44ef-b473-1b73930f20ae service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:20.787667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:20.789467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:20.789854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:20.790289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] PATH_INFO: `/v3/projects/630bfc4183bc458c97de0117d84671c9` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:20.791910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630bfc4183bc458c97de0117d84671c9)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:20.794128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:20.949366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630bfc4183bc458c97de0117d84671c9', 'request_id': 'req-23d693e3-07dd-4642-9cff-e96df2a96334'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.062638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630bfc4183bc458c97de0117d84671c9', 'request_id': 'req-23d693e3-07dd-4642-9cff-e96df2a96334'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.069416 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630bfc4183bc458c97de0117d84671c9', 'request_id': 'req-23d693e3-07dd-4642-9cff-e96df2a96334'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.084228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] The token cache is being invalidate because project 630bfc4183bc458c97de0117d84671c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:21.084516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.085183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.089302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1209/2430] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:20 2022] DELETE /identity/v3/projects/630bfc4183bc458c97de0117d84671c9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:21.091096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:21.093150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:21.172824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7193d40ab98640c399e88bcdc2659de6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.198895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7193d40ab98640c399e88bcdc2659de6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.201384 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d693e3-07dd-4642-9cff-e96df2a96334 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:21.203122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7193d40ab98640c399e88bcdc2659de6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.204455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7193d40ab98640c399e88bcdc2659de6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.211682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:21.213152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:21.213610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:21.213889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] PATH_INFO: `/v3/users/648e211954f8490d9838bff955bbea70` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:21.215199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648e211954f8490d9838bff955bbea70)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:21.217176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:21.315218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7193d40ab98640c399e88bcdc2659de6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.333123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1222/2431] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:20 2022] DELETE /identity/v3/users/7193d40ab98640c399e88bcdc2659de6 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:21.472027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648e211954f8490d9838bff955bbea70'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.488036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648e211954f8490d9838bff955bbea70'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.489064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648e211954f8490d9838bff955bbea70'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.489927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648e211954f8490d9838bff955bbea70'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.640588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648e211954f8490d9838bff955bbea70'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:21.655939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1210/2432] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:21 2022] DELETE /identity/v3/users/648e211954f8490d9838bff955bbea70 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:11:21.690095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:21.692330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:21.778786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6c238-eb21-4c17-bda0-ffc43f9804e1 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:21.855354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:21.856223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:21.856507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:21.856787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] PATH_INFO: `/v3/projects/88a63492d899456b992ad5ab7c8affca` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:21.858039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a63492d899456b992ad5ab7c8affca)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:21.859971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:22.229141 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a63492d899456b992ad5ab7c8affca', 'request_id': 'req-78be20e4-c639-47a9-b335-2a358f6c9f60'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.486239 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a63492d899456b992ad5ab7c8affca', 'request_id': 'req-78be20e4-c639-47a9-b335-2a358f6c9f60'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.492193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a63492d899456b992ad5ab7c8affca', 'request_id': 'req-78be20e4-c639-47a9-b335-2a358f6c9f60'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.504986 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] The token cache is being invalidate because project 88a63492d899456b992ad5ab7c8affca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:22.505385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.506186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.507497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1223/2433] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:21 2022] DELETE /identity/v3/projects/88a63492d899456b992ad5ab7c8affca => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:22.517431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:22.519312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:22.536269 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf2e98-ab48-483e-ac47-3ed4a83b7d42 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:22.601146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:22.602055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:22.602339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:22.602618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] PATH_INFO: `/v3/users/086db52043b6409fbff0d47d7b045b47` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:22.603835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=086db52043b6409fbff0d47d7b045b47)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:22.605815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:22.652387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:22.653865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:22.669891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be20e4-c639-47a9-b335-2a358f6c9f60 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:22.676113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:22.676907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:22.677110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:22.677420 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] PATH_INFO: `/v3/projects/7827098ef3564cd98ae46799d68f0c42` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:22.678901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7827098ef3564cd98ae46799d68f0c42)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:22.682222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:22.881487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086db52043b6409fbff0d47d7b045b47'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.888925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7827098ef3564cd98ae46799d68f0c42', 'request_id': 'req-0494fc1a-8bf6-422a-ae16-353a5e9d055c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.903538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086db52043b6409fbff0d47d7b045b47'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.904278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086db52043b6409fbff0d47d7b045b47'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:22.907592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086db52043b6409fbff0d47d7b045b47'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.013806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7827098ef3564cd98ae46799d68f0c42', 'request_id': 'req-0494fc1a-8bf6-422a-ae16-353a5e9d055c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.021042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7827098ef3564cd98ae46799d68f0c42', 'request_id': 'req-0494fc1a-8bf6-422a-ae16-353a5e9d055c'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.034090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] The token cache is being invalidate because project 7827098ef3564cd98ae46799d68f0c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:23.034693 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.035571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-0494fc1a-8bf6-422a-ae16-353a5e9d055c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.037179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1224/2434] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:22 2022] DELETE /identity/v3/projects/7827098ef3564cd98ae46799d68f0c42 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:11:23.045079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4129376-ec51-4e34-82ea-4ed1e11300fb None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.045578 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4129376-ec51-4e34-82ea-4ed1e11300fb None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.045887 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4129376-ec51-4e34-82ea-4ed1e11300fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.067734 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c4129376-ec51-4e34-82ea-4ed1e11300fb None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:23.069456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c4129376-ec51-4e34-82ea-4ed1e11300fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:23.091796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-714ceb58-abd3-48cb-9272-0b99212ddd8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086db52043b6409fbff0d47d7b045b47'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.113529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1211/2435] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:22 2022] DELETE /identity/v3/users/086db52043b6409fbff0d47d7b045b47 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:23.143088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1225/2436] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:23.152296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccdec2-4f55-401c-8471-6452ef3c035e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.153023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccdec2-4f55-401c-8471-6452ef3c035e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.153425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccdec2-4f55-401c-8471-6452ef3c035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.182854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-c8ccdec2-4f55-401c-8471-6452ef3c035e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:23.185963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c8ccdec2-4f55-401c-8471-6452ef3c035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:23.282807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1212/2437] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:23.288029 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4129376-ec51-4e34-82ea-4ed1e11300fb None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:23.301564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4129376-ec51-4e34-82ea-4ed1e11300fb None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:23.310359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:23.311473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.311869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.312284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.313391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:11:23.313823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:23.315888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:23.337138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1226/2438] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:11:23.341459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccdec2-4f55-401c-8471-6452ef3c035e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:23.351463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccdec2-4f55-401c-8471-6452ef3c035e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:23.357995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3b92f-4049-4839-9d7d-04eecc845007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:23.358687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3b92f-4049-4839-9d7d-04eecc845007 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.358992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3b92f-4049-4839-9d7d-04eecc845007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.359227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3b92f-4049-4839-9d7d-04eecc845007 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.359939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3b92f-4049-4839-9d7d-04eecc845007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:23.361953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3b92f-4049-4839-9d7d-04eecc845007 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:23.509444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:23.511584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:23.528940 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a24d3-2a4c-46d0-8e8a-1f38b15010b1 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:23.535127 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1213/2439] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:23 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:23.536152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3b92f-4049-4839-9d7d-04eecc845007 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:23.613694 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:23.614577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.614874 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.615318 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] PATH_INFO: `/v3/projects/f069da9dd6984432a143e118febee213` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.616389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f069da9dd6984432a143e118febee213)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:23.618981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:23.621617 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3b92f-4049-4839-9d7d-04eecc845007 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:23.626579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59902580-d35f-4a87-9052-fbca35e9de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:23.627291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902580-d35f-4a87-9052-fbca35e9de9a admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.627572 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902580-d35f-4a87-9052-fbca35e9de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.627845 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59902580-d35f-4a87-9052-fbca35e9de9a admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.628552 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59902580-d35f-4a87-9052-fbca35e9de9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:23.630608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59902580-d35f-4a87-9052-fbca35e9de9a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:23.786724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1214/2440] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:23 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:11:23.792928 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59902580-d35f-4a87-9052-fbca35e9de9a admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:23.809472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59902580-d35f-4a87-9052-fbca35e9de9a admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:23.814301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7bea-09d8-4c6b-a8ec-1cc7a9bda5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:23.815005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7bea-09d8-4c6b-a8ec-1cc7a9bda5ba admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.815282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7bea-09d8-4c6b-a8ec-1cc7a9bda5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.815556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7bea-09d8-4c6b-a8ec-1cc7a9bda5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.816315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd7bea-09d8-4c6b-a8ec-1cc7a9bda5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:23.817977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd7bea-09d8-4c6b-a8ec-1cc7a9bda5ba admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:23.828471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1215/2441] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:11:23.833374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7bea-09d8-4c6b-a8ec-1cc7a9bda5ba admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:23.850679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7bea-09d8-4c6b-a8ec-1cc7a9bda5ba admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:23.850930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f069da9dd6984432a143e118febee213', 'request_id': 'req-80ef2659-38d6-4daa-8b5a-df10e18f1933'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.944400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6969af-5a88-43f5-ae69-082b6164df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:23.945081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6969af-5a88-43f5-ae69-082b6164df15 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.945410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6969af-5a88-43f5-ae69-082b6164df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.945693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6969af-5a88-43f5-ae69-082b6164df15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.946613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6969af-5a88-43f5-ae69-082b6164df15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:23.948374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6969af-5a88-43f5-ae69-082b6164df15 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:23.960935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1216/2442] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:11:23.966728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f069da9dd6984432a143e118febee213', 'request_id': 'req-80ef2659-38d6-4daa-8b5a-df10e18f1933'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.967366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6969af-5a88-43f5-ae69-082b6164df15 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:23.976195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f069da9dd6984432a143e118febee213', 'request_id': 'req-80ef2659-38d6-4daa-8b5a-df10e18f1933'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.980323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6969af-5a88-43f5-ae69-082b6164df15 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:23.986031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb734065-ca9b-4366-92c8-2345b12a6e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:23.987146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734065-ca9b-4366-92c8-2345b12a6e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:23.987610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734065-ca9b-4366-92c8-2345b12a6e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:23.988059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb734065-ca9b-4366-92c8-2345b12a6e26 admin admin] PATH_INFO: `/v3/projects/4effa274df6441b0a5474986aa49bc6f/users/bde76643e6cb439fb9702ac04e6dc15f/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:23.991030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] The token cache is being invalidate because project f069da9dd6984432a143e118febee213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:23.991396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.992079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-80ef2659-38d6-4daa-8b5a-df10e18f1933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:23.993755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1227/2443] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:23 2022] DELETE /identity/v3/projects/f069da9dd6984432a143e118febee213 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:11:24.006099 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb734065-ca9b-4366-92c8-2345b12a6e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4effa274df6441b0a5474986aa49bc6f, user_id=bde76643e6cb439fb9702ac04e6dc15f, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:24.009438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb734065-ca9b-4366-92c8-2345b12a6e26 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:24.151271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1217/2444] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:23 2022] PUT /identity/v3/projects/4effa274df6441b0a5474986aa49bc6f/users/bde76643e6cb439fb9702ac04e6dc15f/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:24.165266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e812-4217-4d9e-8e6c-ff36d24b9ac2 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:24.165599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e812-4217-4d9e-8e6c-ff36d24b9ac2 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:24.165915 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e812-4217-4d9e-8e6c-ff36d24b9ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:24.197842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1da3e812-4217-4d9e-8e6c-ff36d24b9ac2 None None] MFA Rules not processed for user `bde76643e6cb439fb9702ac04e6dc15f`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:24.199147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1da3e812-4217-4d9e-8e6c-ff36d24b9ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:24.267652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230a8a-235d-4e4b-9db0-041d08b8c0f3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:24.268184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230a8a-235d-4e4b-9db0-041d08b8c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:24.268734 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75230a8a-235d-4e4b-9db0-041d08b8c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:24.290570 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-75230a8a-235d-4e4b-9db0-041d08b8c0f3 None None] MFA Rules not processed for user `bc34505203634f36af6ef486b5ac598d`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:24.291865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-75230a8a-235d-4e4b-9db0-041d08b8c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:24.305204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1228/2445] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:24.310458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3e812-4217-4d9e-8e6c-ff36d24b9ac2 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:24.311903 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1da3e812-4217-4d9e-8e6c-ff36d24b9ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:24.356292 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1218/2446] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:24.379999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3e812-4217-4d9e-8e6c-ff36d24b9ac2 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:24.386836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19bf5d-0a08-4be2-b19d-d221951def8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:24.387858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19bf5d-0a08-4be2-b19d-d221951def8f admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:24.388009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19bf5d-0a08-4be2-b19d-d221951def8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:24.388700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19bf5d-0a08-4be2-b19d-d221951def8f admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:24.388909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19bf5d-0a08-4be2-b19d-d221951def8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:24.390841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19bf5d-0a08-4be2-b19d-d221951def8f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:24.495024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1229/2447] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:24 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:11:24.499358 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75230a8a-235d-4e4b-9db0-041d08b8c0f3 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:24.512763 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75230a8a-235d-4e4b-9db0-041d08b8c0f3 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:24.587721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149cb43-8a91-439a-abf2-9ac439704ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:24.588669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149cb43-8a91-439a-abf2-9ac439704ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:24.588957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149cb43-8a91-439a-abf2-9ac439704ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:24.589281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149cb43-8a91-439a-abf2-9ac439704ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:24.590060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149cb43-8a91-439a-abf2-9ac439704ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:24.592169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149cb43-8a91-439a-abf2-9ac439704ad8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:24.718044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1219/2448] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:24 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:11:24.722276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19bf5d-0a08-4be2-b19d-d221951def8f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:24.734909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19bf5d-0a08-4be2-b19d-d221951def8f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:24.740308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb632b-e39d-44f4-a359-b18affe29616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:24.741037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb632b-e39d-44f4-a359-b18affe29616 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:24.746130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb632b-e39d-44f4-a359-b18affe29616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:24.746590 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb632b-e39d-44f4-a359-b18affe29616 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:24.747451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb632b-e39d-44f4-a359-b18affe29616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:24.749161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb632b-e39d-44f4-a359-b18affe29616 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:24.762116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1230/2449] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:24.767113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149cb43-8a91-439a-abf2-9ac439704ad8 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:24.783456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149cb43-8a91-439a-abf2-9ac439704ad8 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:24.788709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acce4f-98b8-411e-8d9c-5a5978311ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:24.789655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acce4f-98b8-411e-8d9c-5a5978311ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:24.789972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acce4f-98b8-411e-8d9c-5a5978311ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:24.790831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acce4f-98b8-411e-8d9c-5a5978311ad4 admin admin] PATH_INFO: `/v3/projects/96cb98ba71414621b322c338b442a5d2/users/fcf5ec4ab3e948d7bfd080df77c3511e/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:24.808207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acce4f-98b8-411e-8d9c-5a5978311ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cb98ba71414621b322c338b442a5d2, user_id=fcf5ec4ab3e948d7bfd080df77c3511e, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:24.810981 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acce4f-98b8-411e-8d9c-5a5978311ad4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:24.895123 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1220/2450] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:24 2022] PUT /identity/v3/projects/96cb98ba71414621b322c338b442a5d2/users/fcf5ec4ab3e948d7bfd080df77c3511e/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:24.899249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb632b-e39d-44f4-a359-b18affe29616 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:24.914561 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb632b-e39d-44f4-a359-b18affe29616 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:24.978040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c95636-38af-4526-9ce0-93074b574993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:24.979458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c95636-38af-4526-9ce0-93074b574993 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:24.979743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c95636-38af-4526-9ce0-93074b574993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:24.980021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c95636-38af-4526-9ce0-93074b574993 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:24.980794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c95636-38af-4526-9ce0-93074b574993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:24.982405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c95636-38af-4526-9ce0-93074b574993 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:24.992696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1231/2451] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:24.997889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acce4f-98b8-411e-8d9c-5a5978311ad4 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:25.009124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acce4f-98b8-411e-8d9c-5a5978311ad4 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:25.014106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:25.015002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:25.015288 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:25.015563 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] PATH_INFO: `/v3/projects/96cb98ba71414621b322c338b442a5d2/users/fcf5ec4ab3e948d7bfd080df77c3511e/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:25.017631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cb98ba71414621b322c338b442a5d2, user_id=fcf5ec4ab3e948d7bfd080df77c3511e, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:25.020296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:25.031265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1221/2452] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:24 2022] PUT /identity/v3/projects/96cb98ba71414621b322c338b442a5d2/users/fcf5ec4ab3e948d7bfd080df77c3511e/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:25.042676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3c984-a691-45ec-a57b-35e002e1694a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:25.042965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3c984-a691-45ec-a57b-35e002e1694a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:25.043245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3c984-a691-45ec-a57b-35e002e1694a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:25.071433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-36c3c984-a691-45ec-a57b-35e002e1694a None None] MFA Rules not processed for user `fcf5ec4ab3e948d7bfd080df77c3511e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:25.073318 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-36c3c984-a691-45ec-a57b-35e002e1694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:25.154764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1232/2453] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:25.166581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:25.169924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:25.254547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5acbd2-a22e-4740-b621-4752aedbed43 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:25.258722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4a67-c6bc-49b1-980c-1133c9134589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:25.259503 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a67-c6bc-49b1-980c-1133c9134589 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:25.259775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a67-c6bc-49b1-980c-1133c9134589 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:25.260136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4a67-c6bc-49b1-980c-1133c9134589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:25.272807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff4a67-c6bc-49b1-980c-1133c9134589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:25.274976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff4a67-c6bc-49b1-980c-1133c9134589 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:25.288230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1222/2454] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:25.465706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3c984-a691-45ec-a57b-35e002e1694a None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:25.467328 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-36c3c984-a691-45ec-a57b-35e002e1694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:25.481010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3c984-a691-45ec-a57b-35e002e1694a None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:25.485196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:25.485899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:25.486184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:25.486461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:25.555073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:25.556654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:25.567056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1233/2455] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:29.912810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9ffa-65d7-49db-a2e0-89b710741fab None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:29.912810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9ffa-65d7-49db-a2e0-89b710741fab None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:29.912810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c9ffa-65d7-49db-a2e0-89b710741fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:29.953014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-f56c9ffa-65d7-49db-a2e0-89b710741fab None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:29.953014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f56c9ffa-65d7-49db-a2e0-89b710741fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:30.049641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1223/2456] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:30.064846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:30.068815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:30.267454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecf3f2-6e5b-4bdb-86ef-4ac88adaca96 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:30.279666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a85765-c6ce-47ee-abe8-1de721217ea5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:30.280127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85765-c6ce-47ee-abe8-1de721217ea5 service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:30.280606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85765-c6ce-47ee-abe8-1de721217ea5 service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:30.281015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85765-c6ce-47ee-abe8-1de721217ea5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:30.301451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a85765-c6ce-47ee-abe8-1de721217ea5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:30.303089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a85765-c6ce-47ee-abe8-1de721217ea5 service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:30.315785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1234/2457] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:11:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:11:32.370469 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c9ffa-65d7-49db-a2e0-89b710741fab None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:32.536855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c9ffa-65d7-49db-a2e0-89b710741fab None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:32.543919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:32.545104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:32.545718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:32.546149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] PATH_INFO: `/v3/users/bde76643e6cb439fb9702ac04e6dc15f` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:32.547962 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde76643e6cb439fb9702ac04e6dc15f)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:32.550114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:32.920517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde76643e6cb439fb9702ac04e6dc15f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:32.995046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde76643e6cb439fb9702ac04e6dc15f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:32.996473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde76643e6cb439fb9702ac04e6dc15f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:32.997668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde76643e6cb439fb9702ac04e6dc15f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:33.097641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde76643e6cb439fb9702ac04e6dc15f'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:33.117853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1224/2458] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:32 2022] DELETE /identity/v3/users/bde76643e6cb439fb9702ac04e6dc15f => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:33.123899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4384-4161-43f2-b32c-0b0fa2a973a9 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:33.124894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4384-4161-43f2-b32c-0b0fa2a973a9 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:33.125417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4384-4161-43f2-b32c-0b0fa2a973a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:33.170461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f31b4384-4161-43f2-b32c-0b0fa2a973a9 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:33.174727 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f31b4384-4161-43f2-b32c-0b0fa2a973a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:33.288138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1235/2459] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:33.299212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:33.300948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:33.397915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dea75-79fc-4d68-8bfb-2ad15176a75d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:33.403942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b9294-2c6d-4be8-85ac-7e9d663ec3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:33.405172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b9294-2c6d-4be8-85ac-7e9d663ec3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:33.405728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b9294-2c6d-4be8-85ac-7e9d663ec3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:33.406314 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b9294-2c6d-4be8-85ac-7e9d663ec3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:33.423290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b9294-2c6d-4be8-85ac-7e9d663ec3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:33.425164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b9294-2c6d-4be8-85ac-7e9d663ec3c6 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:33.437110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1225/2460] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:34.140778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b4384-4161-43f2-b32c-0b0fa2a973a9 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:34.148989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f31b4384-4161-43f2-b32c-0b0fa2a973a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:34.179907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b4384-4161-43f2-b32c-0b0fa2a973a9 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:34.189453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:34.191871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:34.192819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:34.193535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] PATH_INFO: `/v3/projects/4effa274df6441b0a5474986aa49bc6f` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:34.195994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4effa274df6441b0a5474986aa49bc6f)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:34.200589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:34.352751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4effa274df6441b0a5474986aa49bc6f', 'request_id': 'req-e14f9fc8-2900-4871-87fb-2e2fc7280d71'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.454163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4effa274df6441b0a5474986aa49bc6f', 'request_id': 'req-e14f9fc8-2900-4871-87fb-2e2fc7280d71'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.462353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4effa274df6441b0a5474986aa49bc6f', 'request_id': 'req-e14f9fc8-2900-4871-87fb-2e2fc7280d71'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.481379 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] The token cache is being invalidate because project 4effa274df6441b0a5474986aa49bc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:34.484661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.484661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.484661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1236/2461] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:34 2022] DELETE /identity/v3/projects/4effa274df6441b0a5474986aa49bc6f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:34.489133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b9294-2c6d-4be8-85ac-7e9d663ec3c6 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:34.503880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b9294-2c6d-4be8-85ac-7e9d663ec3c6 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:34.627233 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:34.628317 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:34.628804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:34.629067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] PATH_INFO: `/v3/users/fcf5ec4ab3e948d7bfd080df77c3511e` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:34.630401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf5ec4ab3e948d7bfd080df77c3511e)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:34.632313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:34.851195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf5ec4ab3e948d7bfd080df77c3511e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.876364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf5ec4ab3e948d7bfd080df77c3511e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.877596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf5ec4ab3e948d7bfd080df77c3511e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.878879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf5ec4ab3e948d7bfd080df77c3511e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:34.980788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3adbe483-c442-45d3-8bf5-21c4f9456e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf5ec4ab3e948d7bfd080df77c3511e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:35.011527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1226/2462] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:34 2022] DELETE /identity/v3/users/fcf5ec4ab3e948d7bfd080df77c3511e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:35.633394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:35.636039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:35.663040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f9fc8-2900-4871-87fb-2e2fc7280d71 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:35.747321 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:35.748689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:35.749316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:35.749879 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] PATH_INFO: `/v3/projects/96cb98ba71414621b322c338b442a5d2` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:35.752954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=96cb98ba71414621b322c338b442a5d2)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:35.755368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:35.936132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cb98ba71414621b322c338b442a5d2', 'request_id': 'req-cc6354b5-5842-449c-ba39-cff8b1c235aa'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:36.065899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cb98ba71414621b322c338b442a5d2', 'request_id': 'req-cc6354b5-5842-449c-ba39-cff8b1c235aa'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:36.078758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cb98ba71414621b322c338b442a5d2', 'request_id': 'req-cc6354b5-5842-449c-ba39-cff8b1c235aa'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:36.092625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] The token cache is being invalidate because project 96cb98ba71414621b322c338b442a5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:36.092959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:36.093810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:36.095841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1237/2463] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:35 2022] DELETE /identity/v3/projects/96cb98ba71414621b322c338b442a5d2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:36.103214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8291f-3fca-4a6c-82f5-0a8d625ece15 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:36.103990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8291f-3fca-4a6c-82f5-0a8d625ece15 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:36.103990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8291f-3fca-4a6c-82f5-0a8d625ece15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:36.139771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-94c8291f-3fca-4a6c-82f5-0a8d625ece15 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:36.139771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-94c8291f-3fca-4a6c-82f5-0a8d625ece15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:36.146722 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:36.151080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:36.298802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6354b5-5842-449c-ba39-cff8b1c235aa admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:36.303958 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1227/2464] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:11:36.306807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8afc8-d586-4835-a5eb-7146f8db3637 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:36.307359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8afc8-d586-4835-a5eb-7146f8db3637 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:36.307814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8afc8-d586-4835-a5eb-7146f8db3637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:36.311332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:36.312330 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:36.312856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:36.313276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:36.318204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:36.332134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-cce8afc8-d586-4835-a5eb-7146f8db3637 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:36.333937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-cce8afc8-d586-4835-a5eb-7146f8db3637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:36.347033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:36.352068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:36.352287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1228/2465] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:36.357083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8afc8-d586-4835-a5eb-7146f8db3637 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:36.372251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1238/2466] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:36.376536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8afc8-d586-4835-a5eb-7146f8db3637 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:36.395278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:36.396039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:36.396400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:36.396896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:36.397772 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:11:36.398173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:36.399941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:36.427223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1229/2467] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:11:36.432343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:36.450098 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9930-8a1f-47f4-8699-82f423a13166 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:36.457163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e471-2006-480f-8c99-2b70823b0e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:36.458277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e471-2006-480f-8c99-2b70823b0e4e admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:36.458633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e471-2006-480f-8c99-2b70823b0e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:36.458985 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e471-2006-480f-8c99-2b70823b0e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:36.459761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4e471-2006-480f-8c99-2b70823b0e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:36.461902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4e471-2006-480f-8c99-2b70823b0e4e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:36.568622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1239/2468] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:36 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:36.570001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:36.581117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458caac-7a13-42ac-ba67-931366aa338b admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:36.658323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e69c9-37da-4981-bbe8-27ef86e6b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:36.659067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e69c9-37da-4981-bbe8-27ef86e6b3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:36.659439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e69c9-37da-4981-bbe8-27ef86e6b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:36.659878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e69c9-37da-4981-bbe8-27ef86e6b3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:36.660755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e69c9-37da-4981-bbe8-27ef86e6b3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:36.664027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e69c9-37da-4981-bbe8-27ef86e6b3c8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:37.191373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1230/2469] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:36 2022] POST /identity/v3/users => generated 289 bytes in 621 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:11:37.197475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e471-2006-480f-8c99-2b70823b0e4e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:37.210618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e471-2006-480f-8c99-2b70823b0e4e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:37.222841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f828fd2-1fad-4221-9bb6-41eb8aa10d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:37.224046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828fd2-1fad-4221-9bb6-41eb8aa10d2d admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:37.224568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828fd2-1fad-4221-9bb6-41eb8aa10d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:37.225087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828fd2-1fad-4221-9bb6-41eb8aa10d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:37.226967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f828fd2-1fad-4221-9bb6-41eb8aa10d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:37.230569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f828fd2-1fad-4221-9bb6-41eb8aa10d2d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:37.248489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1240/2470] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:11:37.249787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e69c9-37da-4981-bbe8-27ef86e6b3c8 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:37.266589 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e69c9-37da-4981-bbe8-27ef86e6b3c8 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:37.276716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e69ba-90c0-42c5-80b0-d20e74636b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:37.278980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e69ba-90c0-42c5-80b0-d20e74636b18 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:37.278980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e69ba-90c0-42c5-80b0-d20e74636b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:37.278980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e69ba-90c0-42c5-80b0-d20e74636b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:37.278980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e69ba-90c0-42c5-80b0-d20e74636b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:37.280726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e69ba-90c0-42c5-80b0-d20e74636b18 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:37.303872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1231/2471] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:37.309913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f828fd2-1fad-4221-9bb6-41eb8aa10d2d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:37.328908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f828fd2-1fad-4221-9bb6-41eb8aa10d2d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:37.335296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6c62-6782-42ed-8c11-717257d3dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:37.336628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6c62-6782-42ed-8c11-717257d3dda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:37.336628 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6c62-6782-42ed-8c11-717257d3dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:37.337000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6c62-6782-42ed-8c11-717257d3dda5 admin admin] PATH_INFO: `/v3/projects/d7b7f623966143dd8d11bb3e6596cfa8/users/5085ac3b2b8b4a338bde5d5a96ab9535/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:37.356325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6c62-6782-42ed-8c11-717257d3dda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b7f623966143dd8d11bb3e6596cfa8, user_id=5085ac3b2b8b4a338bde5d5a96ab9535, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:37.359501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6c62-6782-42ed-8c11-717257d3dda5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:37.442846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1241/2472] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:37 2022] PUT /identity/v3/projects/d7b7f623966143dd8d11bb3e6596cfa8/users/5085ac3b2b8b4a338bde5d5a96ab9535/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:11:37.454873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08399-4e50-4f10-9304-907ba21872bf None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:37.455214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08399-4e50-4f10-9304-907ba21872bf None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:37.455519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c08399-4e50-4f10-9304-907ba21872bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:37.492427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b4c08399-4e50-4f10-9304-907ba21872bf None None] MFA Rules not processed for user `5085ac3b2b8b4a338bde5d5a96ab9535`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:37.492427 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b4c08399-4e50-4f10-9304-907ba21872bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:37.599285 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1232/2473] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:37.606208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6c62-6782-42ed-8c11-717257d3dda5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:37.718562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6c62-6782-42ed-8c11-717257d3dda5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:37.726202 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438153-c318-422f-b1f9-50c45eec6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:37.727169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438153-c318-422f-b1f9-50c45eec6df1 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:37.728176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438153-c318-422f-b1f9-50c45eec6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:37.728733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438153-c318-422f-b1f9-50c45eec6df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:37.729706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d438153-c318-422f-b1f9-50c45eec6df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:37.731837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d438153-c318-422f-b1f9-50c45eec6df1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:37.875984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1242/2474] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:37 2022] POST /identity/v3/projects => generated 377 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:37.887480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c08399-4e50-4f10-9304-907ba21872bf None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:37.912588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c08399-4e50-4f10-9304-907ba21872bf None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:38.072015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a8fa-829d-4113-9b02-5216a80519c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:38.072750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a8fa-829d-4113-9b02-5216a80519c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:38.073051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a8fa-829d-4113-9b02-5216a80519c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:38.073655 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a8fa-829d-4113-9b02-5216a80519c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:38.074704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8a8fa-829d-4113-9b02-5216a80519c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:38.077385 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8a8fa-829d-4113-9b02-5216a80519c3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:38.200740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1233/2475] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:37 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:38.205337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438153-c318-422f-b1f9-50c45eec6df1 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:38.219153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438153-c318-422f-b1f9-50c45eec6df1 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:38.225226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a75af-c754-4dd5-93b2-916c64d7a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:38.226185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a75af-c754-4dd5-93b2-916c64d7a8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:38.226525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a75af-c754-4dd5-93b2-916c64d7a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:38.226871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a75af-c754-4dd5-93b2-916c64d7a8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:38.228766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a75af-c754-4dd5-93b2-916c64d7a8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:38.230651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a75af-c754-4dd5-93b2-916c64d7a8b4 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:38.257018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1243/2476] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:38.265802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a8fa-829d-4113-9b02-5216a80519c3 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:38.287707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a8fa-829d-4113-9b02-5216a80519c3 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:38.294565 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfdfb5-a46a-40e8-ab22-c2b95c3ed853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:38.296806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdfb5-a46a-40e8-ab22-c2b95c3ed853 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:38.297109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdfb5-a46a-40e8-ab22-c2b95c3ed853 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:38.297424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfdfb5-a46a-40e8-ab22-c2b95c3ed853 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:38.298213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfdfb5-a46a-40e8-ab22-c2b95c3ed853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:38.299883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfdfb5-a46a-40e8-ab22-c2b95c3ed853 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:38.324402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1234/2477] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:38.339698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a75af-c754-4dd5-93b2-916c64d7a8b4 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:38.339698 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a75af-c754-4dd5-93b2-916c64d7a8b4 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:38.343954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3a0c6-1c83-4026-8aed-20967dfc9430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:38.345414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3a0c6-1c83-4026-8aed-20967dfc9430 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:38.345916 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3a0c6-1c83-4026-8aed-20967dfc9430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:38.346391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3a0c6-1c83-4026-8aed-20967dfc9430 admin admin] PATH_INFO: `/v3/projects/e0e31a68000945f984711724ffbc1d44/users/901c9a2c575147aebe407ed7835916b8/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:38.366922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3a0c6-1c83-4026-8aed-20967dfc9430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e31a68000945f984711724ffbc1d44, user_id=901c9a2c575147aebe407ed7835916b8, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:38.371654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3a0c6-1c83-4026-8aed-20967dfc9430 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:38.518550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1244/2478] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:38 2022] PUT /identity/v3/projects/e0e31a68000945f984711724ffbc1d44/users/901c9a2c575147aebe407ed7835916b8/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:38.528306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939154a-8a6e-4b93-87b6-a9b6d343f657 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:38.541093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939154a-8a6e-4b93-87b6-a9b6d343f657 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:38.541093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939154a-8a6e-4b93-87b6-a9b6d343f657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:38.560596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3939154a-8a6e-4b93-87b6-a9b6d343f657 None None] MFA Rules not processed for user `901c9a2c575147aebe407ed7835916b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:38.562667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3939154a-8a6e-4b93-87b6-a9b6d343f657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:38.667616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1235/2479] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:38.672495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3a0c6-1c83-4026-8aed-20967dfc9430 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:38.764461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3a0c6-1c83-4026-8aed-20967dfc9430 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:38.772182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151768-3035-4a66-8f03-13ed07972051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:38.776155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151768-3035-4a66-8f03-13ed07972051 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:38.776155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151768-3035-4a66-8f03-13ed07972051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:38.776155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151768-3035-4a66-8f03-13ed07972051 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:38.776155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36151768-3035-4a66-8f03-13ed07972051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:38.780073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36151768-3035-4a66-8f03-13ed07972051 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:38.978427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1245/2480] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:38 2022] POST /identity/v3/projects => generated 379 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:38.980213 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939154a-8a6e-4b93-87b6-a9b6d343f657 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:38.994378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939154a-8a6e-4b93-87b6-a9b6d343f657 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:39.085896 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008832-371a-44e8-8cab-65c0f3fff36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:39.086603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008832-371a-44e8-8cab-65c0f3fff36d admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:39.086883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008832-371a-44e8-8cab-65c0f3fff36d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:39.087392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008832-371a-44e8-8cab-65c0f3fff36d admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:39.088209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008832-371a-44e8-8cab-65c0f3fff36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:39.090422 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008832-371a-44e8-8cab-65c0f3fff36d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:39.534577 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1236/2481] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:38 2022] POST /identity/v3/users => generated 296 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:39.536572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151768-3035-4a66-8f03-13ed07972051 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:39.556970 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151768-3035-4a66-8f03-13ed07972051 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:39.564268 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fdf22-9c87-4936-b712-2adc70ed202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:39.564964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fdf22-9c87-4936-b712-2adc70ed202f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:39.565269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fdf22-9c87-4936-b712-2adc70ed202f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:39.565627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fdf22-9c87-4936-b712-2adc70ed202f admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:39.567058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fdf22-9c87-4936-b712-2adc70ed202f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:39.568214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fdf22-9c87-4936-b712-2adc70ed202f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:39.581057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1246/2482] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:39.585097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008832-371a-44e8-8cab-65c0f3fff36d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:39.606112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008832-371a-44e8-8cab-65c0f3fff36d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:39.612452 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b65e2-1a36-4e37-9d26-4a446d50bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:39.613309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b65e2-1a36-4e37-9d26-4a446d50bfd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:39.613594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b65e2-1a36-4e37-9d26-4a446d50bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:39.613870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b65e2-1a36-4e37-9d26-4a446d50bfd3 admin admin] PATH_INFO: `/v3/projects/24aed3dc7b5b44569ff16b3eca674f24/users/b8d28d192e7b40f1ba6b128718642f3e/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:39.636054 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b65e2-1a36-4e37-9d26-4a446d50bfd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24aed3dc7b5b44569ff16b3eca674f24, user_id=b8d28d192e7b40f1ba6b128718642f3e, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:39.638862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b65e2-1a36-4e37-9d26-4a446d50bfd3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:39.753208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1237/2483] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:39 2022] PUT /identity/v3/projects/24aed3dc7b5b44569ff16b3eca674f24/users/b8d28d192e7b40f1ba6b128718642f3e/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:39.757886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fdf22-9c87-4936-b712-2adc70ed202f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:39.770402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fdf22-9c87-4936-b712-2adc70ed202f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:39.852315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf568f-fb11-46ca-8d2d-8c92eb5980cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:39.853741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf568f-fb11-46ca-8d2d-8c92eb5980cd admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:39.855440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf568f-fb11-46ca-8d2d-8c92eb5980cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:39.855440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf568f-fb11-46ca-8d2d-8c92eb5980cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:39.855802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf568f-fb11-46ca-8d2d-8c92eb5980cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:39.858204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf568f-fb11-46ca-8d2d-8c92eb5980cd admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:39.874611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1247/2484] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:39.882482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b65e2-1a36-4e37-9d26-4a446d50bfd3 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:39.899148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b65e2-1a36-4e37-9d26-4a446d50bfd3 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:39.907657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:39.909913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:39.909913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:39.910542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] PATH_INFO: `/v3/projects/24aed3dc7b5b44569ff16b3eca674f24/users/b8d28d192e7b40f1ba6b128718642f3e/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:39.917676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24aed3dc7b5b44569ff16b3eca674f24, user_id=b8d28d192e7b40f1ba6b128718642f3e, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:39.921545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:39.935329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1238/2485] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:39 2022] PUT /identity/v3/projects/24aed3dc7b5b44569ff16b3eca674f24/users/b8d28d192e7b40f1ba6b128718642f3e/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:39.948891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32a62-0002-496e-8117-5f400b2b48fa None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:39.949417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32a62-0002-496e-8117-5f400b2b48fa None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:39.949926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e32a62-0002-496e-8117-5f400b2b48fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:40.000950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-d3e32a62-0002-496e-8117-5f400b2b48fa None None] MFA Rules not processed for user `b8d28d192e7b40f1ba6b128718642f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:40.002861 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d3e32a62-0002-496e-8117-5f400b2b48fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:40.126895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1248/2486] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:40.142550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:40.151476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:40.278306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b731-7cbf-4d8f-aacf-b1de7113be63 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:40.291564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:40.292652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:40.292934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:40.293907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:40.306529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:40.308648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:40.320931 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1239/2487] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:40.478087 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e32a62-0002-496e-8117-5f400b2b48fa None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:40.481831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d3e32a62-0002-496e-8117-5f400b2b48fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:40.514700 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e32a62-0002-496e-8117-5f400b2b48fa None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:40.527122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:40.527122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:40.527122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:40.527122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:40.694801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:40.708133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:40.733918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1249/2488] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:42.182678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:42.184310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:42.256925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3ba62-54d4-412e-9835-f83ab7f48f50 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:42.262510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:42.263592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:42.263924 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:42.264200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] PATH_INFO: `/v3/users/b32e32eb1444401b9b7d8ab3228bdfd0` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:42.265506 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32e32eb1444401b9b7d8ab3228bdfd0)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:42.267708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:42.318358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:42.320001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:42.396545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72f9c-926b-41dd-8501-a020aedb7c63 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:42.401998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ffd2170c2243eab4511fced8d67ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:42.402796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:42.403073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:42.403344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:42.405286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:42.420549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:42.422273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:42.434598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1250/2489] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:11:42.488910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32e32eb1444401b9b7d8ab3228bdfd0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:42.506919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32e32eb1444401b9b7d8ab3228bdfd0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:42.507735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32e32eb1444401b9b7d8ab3228bdfd0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:42.508539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32e32eb1444401b9b7d8ab3228bdfd0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:42.591171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-35366cd1-5b1b-4657-a9aa-90c316657091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32e32eb1444401b9b7d8ab3228bdfd0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:42.612411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1240/2490] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:42 2022] DELETE /identity/v3/users/b32e32eb1444401b9b7d8ab3228bdfd0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:43.045858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:43.057678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3120e-85a3-460f-b51b-d7ca3a25aeb9 service placement] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:43.131035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:43.132074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:43.132452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:43.132902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] PATH_INFO: `/v3/projects/8519562477d14e15ac77e0647ec78c88` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:43.134696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8519562477d14e15ac77e0647ec78c88)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:43.137227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:43.301545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8519562477d14e15ac77e0647ec78c88', 'request_id': 'req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:43.470543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8519562477d14e15ac77e0647ec78c88', 'request_id': 'req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:43.476683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8519562477d14e15ac77e0647ec78c88', 'request_id': 'req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:43.488805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] The token cache is being invalidate because project 8519562477d14e15ac77e0647ec78c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:43.489104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:43.489773 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fa0d6624-6e1c-4db1-8606-aa8c1c2d6d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:43.491396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1251/2491] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:43 2022] DELETE /identity/v3/projects/8519562477d14e15ac77e0647ec78c88 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:43.496718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf192-9633-4c74-9338-267a261407b7 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:43.497208 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf192-9633-4c74-9338-267a261407b7 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:43.497347 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf192-9633-4c74-9338-267a261407b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:43.517377 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-5dcbf192-9633-4c74-9338-267a261407b7 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:43.517377 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-5dcbf192-9633-4c74-9338-267a261407b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:43.585420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1241/2492] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:43.594774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ade53-c19c-47f2-8ae3-22a026a8ff59 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:43.595912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ade53-c19c-47f2-8ae3-22a026a8ff59 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:43.595912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ade53-c19c-47f2-8ae3-22a026a8ff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:43.617753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7a9ade53-c19c-47f2-8ae3-22a026a8ff59 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:43.619179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7a9ade53-c19c-47f2-8ae3-22a026a8ff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:43.630380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1252/2493] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:43.632959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbf192-9633-4c74-9338-267a261407b7 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:43.643935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbf192-9633-4c74-9338-267a261407b7 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:43.648604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:43.649306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:43.650413 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:43.651029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:43.651370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:11:43.651680 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:43.653350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:43.666623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1242/2494] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:11:43.671517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ade53-c19c-47f2-8ae3-22a026a8ff59 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:43.682741 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ade53-c19c-47f2-8ae3-22a026a8ff59 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:43.689131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad998c-f692-4daf-87d7-123e96d10737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:43.689868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad998c-f692-4daf-87d7-123e96d10737 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:43.690190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad998c-f692-4daf-87d7-123e96d10737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:43.690435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad998c-f692-4daf-87d7-123e96d10737 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:43.691892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad998c-f692-4daf-87d7-123e96d10737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:43.693357 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad998c-f692-4daf-87d7-123e96d10737 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:43.871856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1253/2495] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:43 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:11:43.876103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:43.890917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e62c1-afe7-4a31-8b92-82d812411e8d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:43.955857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f438fe8-d172-4e66-b84a-6c38d8529502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:43.956526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f438fe8-d172-4e66-b84a-6c38d8529502 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:43.956813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f438fe8-d172-4e66-b84a-6c38d8529502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:43.957088 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f438fe8-d172-4e66-b84a-6c38d8529502 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:43.957813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f438fe8-d172-4e66-b84a-6c38d8529502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:43.959776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f438fe8-d172-4e66-b84a-6c38d8529502 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:44.078143 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1243/2496] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:43 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:44.082189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad998c-f692-4daf-87d7-123e96d10737 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:44.092980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad998c-f692-4daf-87d7-123e96d10737 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:44.097587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcba0c5-953c-48b5-a005-6adfafbeeb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:44.098329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcba0c5-953c-48b5-a005-6adfafbeeb2f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:44.098688 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcba0c5-953c-48b5-a005-6adfafbeeb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:44.098953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcba0c5-953c-48b5-a005-6adfafbeeb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:44.099686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcba0c5-953c-48b5-a005-6adfafbeeb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:44.102082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcba0c5-953c-48b5-a005-6adfafbeeb2f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:44.114214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1254/2497] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:44.132787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f438fe8-d172-4e66-b84a-6c38d8529502 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:44.143930 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f438fe8-d172-4e66-b84a-6c38d8529502 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:44.149794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109f58-aa2d-4f35-8fe5-060a4c8ca53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:44.150396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109f58-aa2d-4f35-8fe5-060a4c8ca53a admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:44.150823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109f58-aa2d-4f35-8fe5-060a4c8ca53a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:44.151102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109f58-aa2d-4f35-8fe5-060a4c8ca53a admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:44.151902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73109f58-aa2d-4f35-8fe5-060a4c8ca53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:44.153531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73109f58-aa2d-4f35-8fe5-060a4c8ca53a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:44.165387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1244/2498] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:44.169788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcba0c5-953c-48b5-a005-6adfafbeeb2f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:44.179629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcba0c5-953c-48b5-a005-6adfafbeeb2f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:44.185172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d8cce-f5f4-4d78-a1d2-81e027884106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:44.186106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8cce-f5f4-4d78-a1d2-81e027884106 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:44.186415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8cce-f5f4-4d78-a1d2-81e027884106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:44.186691 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d8cce-f5f4-4d78-a1d2-81e027884106 admin admin] PATH_INFO: `/v3/projects/98fff03d1ced4b58a2560bca3bf0a850/users/71322cd2abaf4cb4a8ca78f17de978b9/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:44.202611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d8cce-f5f4-4d78-a1d2-81e027884106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98fff03d1ced4b58a2560bca3bf0a850, user_id=71322cd2abaf4cb4a8ca78f17de978b9, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:44.205418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d8cce-f5f4-4d78-a1d2-81e027884106 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:45.094727 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1255/2499] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:44 2022] PUT /identity/v3/projects/98fff03d1ced4b58a2560bca3bf0a850/users/71322cd2abaf4cb4a8ca78f17de978b9/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:45.106366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038597b-545c-46c0-a648-7c0bc4608721 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:45.106959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038597b-545c-46c0-a648-7c0bc4608721 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:45.106959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038597b-545c-46c0-a648-7c0bc4608721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:45.139029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-2038597b-545c-46c0-a648-7c0bc4608721 None None] MFA Rules not processed for user `71322cd2abaf4cb4a8ca78f17de978b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:45.140289 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2038597b-545c-46c0-a648-7c0bc4608721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:45.228706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1245/2500] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:45.234948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d8cce-f5f4-4d78-a1d2-81e027884106 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:45.312170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d8cce-f5f4-4d78-a1d2-81e027884106 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:45.317116 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a630015-1060-4460-9281-f41bc458374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:45.317823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a630015-1060-4460-9281-f41bc458374f admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:45.318154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a630015-1060-4460-9281-f41bc458374f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:45.318390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a630015-1060-4460-9281-f41bc458374f admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:45.319105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a630015-1060-4460-9281-f41bc458374f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:45.321045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a630015-1060-4460-9281-f41bc458374f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:45.511430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1256/2501] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:45 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:45.516694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038597b-545c-46c0-a648-7c0bc4608721 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:45.530799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038597b-545c-46c0-a648-7c0bc4608721 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:45.613461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192955aa-7b8a-4df6-9b88-2e3458dd8a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:45.614247 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192955aa-7b8a-4df6-9b88-2e3458dd8a87 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:45.614636 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192955aa-7b8a-4df6-9b88-2e3458dd8a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:45.615016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192955aa-7b8a-4df6-9b88-2e3458dd8a87 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:45.615812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192955aa-7b8a-4df6-9b88-2e3458dd8a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:45.618394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192955aa-7b8a-4df6-9b88-2e3458dd8a87 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:45.768139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1246/2502] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:45 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:45.772488 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a630015-1060-4460-9281-f41bc458374f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:45.782850 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a630015-1060-4460-9281-f41bc458374f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:45.787558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca71896-f7f3-4f19-b930-e64aba4c6b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:45.788220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71896-f7f3-4f19-b930-e64aba4c6b14 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:45.788526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71896-f7f3-4f19-b930-e64aba4c6b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:45.788809 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca71896-f7f3-4f19-b930-e64aba4c6b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:45.790046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca71896-f7f3-4f19-b930-e64aba4c6b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:45.791307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca71896-f7f3-4f19-b930-e64aba4c6b14 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:45.809672 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1257/2503] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:45.814222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192955aa-7b8a-4df6-9b88-2e3458dd8a87 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:45.825407 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192955aa-7b8a-4df6-9b88-2e3458dd8a87 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:45.830316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f2f3-5cd8-4425-8053-ad4d599d489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:45.831248 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f2f3-5cd8-4425-8053-ad4d599d489d admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:45.831528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f2f3-5cd8-4425-8053-ad4d599d489d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:45.831805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46f2f3-5cd8-4425-8053-ad4d599d489d admin admin] PATH_INFO: `/v3/projects/3e9261ec73364f7184997dab9ed903c6/users/f2694ab87f314e06a04adfe42d479446/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:45.848094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46f2f3-5cd8-4425-8053-ad4d599d489d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9261ec73364f7184997dab9ed903c6, user_id=f2694ab87f314e06a04adfe42d479446, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:45.850831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46f2f3-5cd8-4425-8053-ad4d599d489d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:45.988408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1247/2504] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:45 2022] PUT /identity/v3/projects/3e9261ec73364f7184997dab9ed903c6/users/f2694ab87f314e06a04adfe42d479446/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:45.992553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca71896-f7f3-4f19-b930-e64aba4c6b14 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:46.005370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca71896-f7f3-4f19-b930-e64aba4c6b14 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:46.073352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ff3f4-eaed-4079-963f-2c2a79362b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:46.073932 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff3f4-eaed-4079-963f-2c2a79362b6f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:46.074218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff3f4-eaed-4079-963f-2c2a79362b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:46.074505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ff3f4-eaed-4079-963f-2c2a79362b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:46.075241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ff3f4-eaed-4079-963f-2c2a79362b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:46.076947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ff3f4-eaed-4079-963f-2c2a79362b6f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:46.087297 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1258/2505] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:46.091600 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f2f3-5cd8-4425-8053-ad4d599d489d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:46.102151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46f2f3-5cd8-4425-8053-ad4d599d489d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:46.107977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:46.108923 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:46.109211 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:46.109839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] PATH_INFO: `/v3/projects/3e9261ec73364f7184997dab9ed903c6/users/f2694ab87f314e06a04adfe42d479446/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:46.112204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9261ec73364f7184997dab9ed903c6, user_id=f2694ab87f314e06a04adfe42d479446, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:46.114879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:46.130498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1248/2506] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:46 2022] PUT /identity/v3/projects/3e9261ec73364f7184997dab9ed903c6/users/f2694ab87f314e06a04adfe42d479446/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:46.141428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324484f1-c043-41eb-b331-00a79e46bae5 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:46.144890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324484f1-c043-41eb-b331-00a79e46bae5 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:46.144890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324484f1-c043-41eb-b331-00a79e46bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:46.175075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-324484f1-c043-41eb-b331-00a79e46bae5 None None] MFA Rules not processed for user `f2694ab87f314e06a04adfe42d479446`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:46.176323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-324484f1-c043-41eb-b331-00a79e46bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:46.259534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1259/2507] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:46.275685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:46.275685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:46.340323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b3206-8b63-45ec-a484-45ff46c59dee admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:46.340323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667abb6b-b48a-42a9-8927-e4a3e81cf163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:46.340323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667abb6b-b48a-42a9-8927-e4a3e81cf163 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:46.340323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667abb6b-b48a-42a9-8927-e4a3e81cf163 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:46.340832 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667abb6b-b48a-42a9-8927-e4a3e81cf163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:46.351014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667abb6b-b48a-42a9-8927-e4a3e81cf163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:46.352126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667abb6b-b48a-42a9-8927-e4a3e81cf163 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:46.363742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1249/2508] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:46.524227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324484f1-c043-41eb-b331-00a79e46bae5 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:46.526519 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-324484f1-c043-41eb-b331-00a79e46bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:46.600922 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324484f1-c043-41eb-b331-00a79e46bae5 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:46.606171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:46.607047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:46.607332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:46.607612 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] PATH_INFO: `/v3/users/5085ac3b2b8b4a338bde5d5a96ab9535` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:46.608812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5085ac3b2b8b4a338bde5d5a96ab9535)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:46.610787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:46.707811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667abb6b-b48a-42a9-8927-e4a3e81cf163 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:46.718149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667abb6b-b48a-42a9-8927-e4a3e81cf163 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:46.723246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78636a-25a8-47c2-a08c-aa535389ff55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:46.723906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78636a-25a8-47c2-a08c-aa535389ff55 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:46.724272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78636a-25a8-47c2-a08c-aa535389ff55 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:46.724654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78636a-25a8-47c2-a08c-aa535389ff55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:46.798016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78636a-25a8-47c2-a08c-aa535389ff55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:46.799498 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78636a-25a8-47c2-a08c-aa535389ff55 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:46.810282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1250/2509] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:11:46.872955 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5085ac3b2b8b4a338bde5d5a96ab9535'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:46.895633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5085ac3b2b8b4a338bde5d5a96ab9535'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:46.896769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5085ac3b2b8b4a338bde5d5a96ab9535'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:46.898280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5085ac3b2b8b4a338bde5d5a96ab9535'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:47.002402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5085ac3b2b8b4a338bde5d5a96ab9535'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:47.018984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1260/2510] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:46 2022] DELETE /identity/v3/users/5085ac3b2b8b4a338bde5d5a96ab9535 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:47.023640 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db863e-1144-4fcc-a773-75b2ccb78a9b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:47.023938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db863e-1144-4fcc-a773-75b2ccb78a9b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:47.024222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db863e-1144-4fcc-a773-75b2ccb78a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:47.042737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-68db863e-1144-4fcc-a773-75b2ccb78a9b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:47.043990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-68db863e-1144-4fcc-a773-75b2ccb78a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:47.137536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1251/2511] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:11:47.147360 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:47.149732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:47.227193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185b265-6fbf-4b3c-ae4d-455f01aa90aa admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:47.232004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2b524-b2b6-4499-86e2-0e7b11d180b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:47.233038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2b524-b2b6-4499-86e2-0e7b11d180b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:47.233547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2b524-b2b6-4499-86e2-0e7b11d180b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:47.233902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2b524-b2b6-4499-86e2-0e7b11d180b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:47.248287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2b524-b2b6-4499-86e2-0e7b11d180b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:47.249976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2b524-b2b6-4499-86e2-0e7b11d180b4 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:47.263527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1261/2512] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:47.832207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db863e-1144-4fcc-a773-75b2ccb78a9b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:47.833789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-68db863e-1144-4fcc-a773-75b2ccb78a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:47.846990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db863e-1144-4fcc-a773-75b2ccb78a9b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:47.851808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:47.853464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:47.853857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:47.854206 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] PATH_INFO: `/v3/projects/d7b7f623966143dd8d11bb3e6596cfa8` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:47.855419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b7f623966143dd8d11bb3e6596cfa8)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:47.857398 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:47.969542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b7f623966143dd8d11bb3e6596cfa8', 'request_id': 'req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.047921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b7f623966143dd8d11bb3e6596cfa8', 'request_id': 'req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.059091 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b7f623966143dd8d11bb3e6596cfa8', 'request_id': 'req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.077397 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] The token cache is being invalidate because project d7b7f623966143dd8d11bb3e6596cfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:48.080588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.080588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.082388 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1252/2513] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:47 2022] DELETE /identity/v3/projects/d7b7f623966143dd8d11bb3e6596cfa8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:48.086587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2b524-b2b6-4499-86e2-0e7b11d180b4 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:48.110897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2b524-b2b6-4499-86e2-0e7b11d180b4 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:48.178959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:48.180232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:48.181425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:48.181425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] PATH_INFO: `/v3/users/901c9a2c575147aebe407ed7835916b8` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:48.182794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] RBAC: Authorizing `identity:delete_user(user_id=901c9a2c575147aebe407ed7835916b8)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:48.184854 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:48.407264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901c9a2c575147aebe407ed7835916b8'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.420744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901c9a2c575147aebe407ed7835916b8'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.421577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901c9a2c575147aebe407ed7835916b8'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.422240 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901c9a2c575147aebe407ed7835916b8'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.516030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901c9a2c575147aebe407ed7835916b8'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:48.529946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1262/2514] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:48 2022] DELETE /identity/v3/users/901c9a2c575147aebe407ed7835916b8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:49.054730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:49.056834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:49.069940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0ee7-f687-43ed-be7a-d9f7cf7c93f3 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:49.138519 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:49.139660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:49.139942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:49.140222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] PATH_INFO: `/v3/projects/e0e31a68000945f984711724ffbc1d44` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:49.141475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e31a68000945f984711724ffbc1d44)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:49.143393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:49.262706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e31a68000945f984711724ffbc1d44', 'request_id': 'req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.367703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e31a68000945f984711724ffbc1d44', 'request_id': 'req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.373983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e31a68000945f984711724ffbc1d44', 'request_id': 'req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.385822 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] The token cache is being invalidate because project e0e31a68000945f984711724ffbc1d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:49.386112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.386769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.388353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1253/2515] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:49 2022] DELETE /identity/v3/projects/e0e31a68000945f984711724ffbc1d44 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:49.392670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:49.394231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:49.409135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e00f0e-f51e-469a-bb39-a130fb45173a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:49.487367 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:49.503487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:49.503487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:49.503487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] PATH_INFO: `/v3/users/b8d28d192e7b40f1ba6b128718642f3e` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:49.503487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d28d192e7b40f1ba6b128718642f3e)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:49.503487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:49.879485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d28d192e7b40f1ba6b128718642f3e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.891738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d28d192e7b40f1ba6b128718642f3e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.892479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d28d192e7b40f1ba6b128718642f3e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.893097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d28d192e7b40f1ba6b128718642f3e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.979258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-e049cb83-d584-44b5-8c79-964646dd12f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d28d192e7b40f1ba6b128718642f3e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:49.991811 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1263/2516] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:11:49 2022] DELETE /identity/v3/users/b8d28d192e7b40f1ba6b128718642f3e => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:50.563858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:50.565450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:50.582002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcf471-c2b5-4a0e-bcb1-957c33379f63 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:50.639909 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:50.640885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:50.641092 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:50.641410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] PATH_INFO: `/v3/projects/24aed3dc7b5b44569ff16b3eca674f24` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:50.642718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24aed3dc7b5b44569ff16b3eca674f24)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:50.647980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:50.801154 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24aed3dc7b5b44569ff16b3eca674f24', 'request_id': 'req-23a06b0c-a5bd-4191-a4b5-daa800347b29'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:50.893884 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24aed3dc7b5b44569ff16b3eca674f24', 'request_id': 'req-23a06b0c-a5bd-4191-a4b5-daa800347b29'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:50.904101 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24aed3dc7b5b44569ff16b3eca674f24', 'request_id': 'req-23a06b0c-a5bd-4191-a4b5-daa800347b29'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:50.917720 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] The token cache is being invalidate because project 24aed3dc7b5b44569ff16b3eca674f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:11:50.918017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:50.918709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-23a06b0c-a5bd-4191-a4b5-daa800347b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:11:50.920326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1254/2517] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:11:50 2022] DELETE /identity/v3/projects/24aed3dc7b5b44569ff16b3eca674f24 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:11:50.926486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6afb08-bd18-4e5b-9f24-93023f85951e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:50.927014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6afb08-bd18-4e5b-9f24-93023f85951e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:50.927014 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6afb08-bd18-4e5b-9f24-93023f85951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:50.945610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9a6afb08-bd18-4e5b-9f24-93023f85951e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:50.947452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9a6afb08-bd18-4e5b-9f24-93023f85951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:51.006671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1264/2518] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:51.016192 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c81fa-82a1-4a43-b2d1-63746c34a905 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.016482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c81fa-82a1-4a43-b2d1-63746c34a905 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.016764 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c81fa-82a1-4a43-b2d1-63746c34a905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.039635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-718c81fa-82a1-4a43-b2d1-63746c34a905 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:51.041104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-718c81fa-82a1-4a43-b2d1-63746c34a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:51.050386 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1255/2519] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:11:51.054799 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6afb08-bd18-4e5b-9f24-93023f85951e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:51.065475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6afb08-bd18-4e5b-9f24-93023f85951e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:51.070277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:51.070946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.071930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.072213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.072956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:11:51.073292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:51.075038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:51.087459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1265/2520] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:11:51.091815 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c81fa-82a1-4a43-b2d1-63746c34a905 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:51.101142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c81fa-82a1-4a43-b2d1-63746c34a905 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:51.106629 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fda9f-19db-4e47-b042-1202581fd1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:51.107275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fda9f-19db-4e47-b042-1202581fd1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.107560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fda9f-19db-4e47-b042-1202581fd1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.107864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fda9f-19db-4e47-b042-1202581fd1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.108525 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fda9f-19db-4e47-b042-1202581fd1f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:51.110511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fda9f-19db-4e47-b042-1202581fd1f0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:51.199394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1256/2521] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:51 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:51.204335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:51.217344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a4ba-7ada-4526-b49a-f1bdcd79341e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:51.280081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e7ca4-e820-4efa-b589-fa2495f26923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:51.280824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7ca4-e820-4efa-b589-fa2495f26923 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.281040 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7ca4-e820-4efa-b589-fa2495f26923 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.281348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e7ca4-e820-4efa-b589-fa2495f26923 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.282048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e7ca4-e820-4efa-b589-fa2495f26923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:51.287436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e7ca4-e820-4efa-b589-fa2495f26923 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:51.395636 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1266/2522] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:51 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:51.400614 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fda9f-19db-4e47-b042-1202581fd1f0 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:51.411334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fda9f-19db-4e47-b042-1202581fd1f0 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:51.416073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db6b4-3ca0-4c9f-8258-4456954d35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:51.416770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db6b4-3ca0-4c9f-8258-4456954d35e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.417058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db6b4-3ca0-4c9f-8258-4456954d35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.417381 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db6b4-3ca0-4c9f-8258-4456954d35e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.418117 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6db6b4-3ca0-4c9f-8258-4456954d35e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:51.419837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6db6b4-3ca0-4c9f-8258-4456954d35e6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:51.431407 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1257/2523] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:51.435834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e7ca4-e820-4efa-b589-fa2495f26923 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:51.447137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e7ca4-e820-4efa-b589-fa2495f26923 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:51.452004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9119d4-0d38-4551-bed7-fd4ada38b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:51.452692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9119d4-0d38-4551-bed7-fd4ada38b02d admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.452979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9119d4-0d38-4551-bed7-fd4ada38b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.453280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9119d4-0d38-4551-bed7-fd4ada38b02d admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.454026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9119d4-0d38-4551-bed7-fd4ada38b02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:51.455635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9119d4-0d38-4551-bed7-fd4ada38b02d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:51.467737 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1267/2524] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:51.472335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db6b4-3ca0-4c9f-8258-4456954d35e6 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:51.483257 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db6b4-3ca0-4c9f-8258-4456954d35e6 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:51.491551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e923f-2ef5-435c-a015-db8358c10325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:51.492450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e923f-2ef5-435c-a015-db8358c10325 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.492733 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e923f-2ef5-435c-a015-db8358c10325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.493574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e923f-2ef5-435c-a015-db8358c10325 admin admin] PATH_INFO: `/v3/projects/98dbb538e06342e89de9bfab663e0967/users/0c0276e836a34db7a45269df9ca57457/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.509885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e923f-2ef5-435c-a015-db8358c10325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dbb538e06342e89de9bfab663e0967, user_id=0c0276e836a34db7a45269df9ca57457, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:51.512300 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e923f-2ef5-435c-a015-db8358c10325 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:51.620134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1258/2525] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:51 2022] PUT /identity/v3/projects/98dbb538e06342e89de9bfab663e0967/users/0c0276e836a34db7a45269df9ca57457/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:51.632334 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa4b3-7fbd-4c27-9577-363b9855ce16 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.632624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa4b3-7fbd-4c27-9577-363b9855ce16 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.632996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baa4b3-7fbd-4c27-9577-363b9855ce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.661045 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c0baa4b3-7fbd-4c27-9577-363b9855ce16 None None] MFA Rules not processed for user `0c0276e836a34db7a45269df9ca57457`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:51.662305 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c0baa4b3-7fbd-4c27-9577-363b9855ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:51.727170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1268/2526] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:51.732060 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e923f-2ef5-435c-a015-db8358c10325 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:51.795876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e923f-2ef5-435c-a015-db8358c10325 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:51.800568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9859d-d006-4ee3-80e2-c58acb0fb964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:51.801231 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9859d-d006-4ee3-80e2-c58acb0fb964 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.801551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9859d-d006-4ee3-80e2-c58acb0fb964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.801830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9859d-d006-4ee3-80e2-c58acb0fb964 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.802514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9859d-d006-4ee3-80e2-c58acb0fb964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:51.804481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9859d-d006-4ee3-80e2-c58acb0fb964 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:51.895151 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1259/2527] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:11:51 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:51.899428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa4b3-7fbd-4c27-9577-363b9855ce16 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:51.910504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baa4b3-7fbd-4c27-9577-363b9855ce16 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:51.971533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13886c2a-21ba-431a-9add-c8e669db7f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:51.972209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886c2a-21ba-431a-9add-c8e669db7f4e admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:51.972492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886c2a-21ba-431a-9add-c8e669db7f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:51.972772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886c2a-21ba-431a-9add-c8e669db7f4e admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:51.973518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886c2a-21ba-431a-9add-c8e669db7f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:51.975460 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886c2a-21ba-431a-9add-c8e669db7f4e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:52.088153 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1269/2528] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:11:51 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:11:52.092093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9859d-d006-4ee3-80e2-c58acb0fb964 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:52.103282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9859d-d006-4ee3-80e2-c58acb0fb964 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:52.108241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2321617-b1bf-4069-bc70-f9cb730c7390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:52.108905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321617-b1bf-4069-bc70-f9cb730c7390 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:52.109184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321617-b1bf-4069-bc70-f9cb730c7390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:52.109492 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321617-b1bf-4069-bc70-f9cb730c7390 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:52.110248 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2321617-b1bf-4069-bc70-f9cb730c7390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:52.111864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2321617-b1bf-4069-bc70-f9cb730c7390 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:52.124440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1260/2529] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:52.128775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13886c2a-21ba-431a-9add-c8e669db7f4e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:52.139191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13886c2a-21ba-431a-9add-c8e669db7f4e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:52.143896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01380-e32d-4aca-b09b-572256ce7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:52.144762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01380-e32d-4aca-b09b-572256ce7d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:52.145039 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01380-e32d-4aca-b09b-572256ce7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:52.145418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01380-e32d-4aca-b09b-572256ce7d69 admin admin] PATH_INFO: `/v3/projects/208f811543864f9eb9961a09935c1bcb/users/20e61fda068f489e962c3ad3835aca3c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:52.160458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01380-e32d-4aca-b09b-572256ce7d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208f811543864f9eb9961a09935c1bcb, user_id=20e61fda068f489e962c3ad3835aca3c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:52.163235 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01380-e32d-4aca-b09b-572256ce7d69 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:52.242086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1270/2530] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:52 2022] PUT /identity/v3/projects/208f811543864f9eb9961a09935c1bcb/users/20e61fda068f489e962c3ad3835aca3c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:52.246949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2321617-b1bf-4069-bc70-f9cb730c7390 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:52.257135 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2321617-b1bf-4069-bc70-f9cb730c7390 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:52.315673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33903549-ddba-4ae6-9d52-e6f6e95a8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:52.316341 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903549-ddba-4ae6-9d52-e6f6e95a8b68 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:52.316624 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903549-ddba-4ae6-9d52-e6f6e95a8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:52.316901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33903549-ddba-4ae6-9d52-e6f6e95a8b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:52.317657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33903549-ddba-4ae6-9d52-e6f6e95a8b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:52.319264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33903549-ddba-4ae6-9d52-e6f6e95a8b68 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:52.329476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1261/2531] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:11:52.333921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01380-e32d-4aca-b09b-572256ce7d69 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:52.345426 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01380-e32d-4aca-b09b-572256ce7d69 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:52.350103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:52.350983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:52.351271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:52.351730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] PATH_INFO: `/v3/projects/208f811543864f9eb9961a09935c1bcb/users/20e61fda068f489e962c3ad3835aca3c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:52.354655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=208f811543864f9eb9961a09935c1bcb, user_id=20e61fda068f489e962c3ad3835aca3c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:52.357840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:52.367817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1271/2532] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:11:52 2022] PUT /identity/v3/projects/208f811543864f9eb9961a09935c1bcb/users/20e61fda068f489e962c3ad3835aca3c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:11:52.378301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7cd9c-7c87-4acf-b7bf-69b43c9307ce None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:52.378593 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7cd9c-7c87-4acf-b7bf-69b43c9307ce None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:52.378876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7cd9c-7c87-4acf-b7bf-69b43c9307ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:52.407547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-40e7cd9c-7c87-4acf-b7bf-69b43c9307ce None None] MFA Rules not processed for user `20e61fda068f489e962c3ad3835aca3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:11:52.408684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-40e7cd9c-7c87-4acf-b7bf-69b43c9307ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:52.478491 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1262/2533] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:11:52.490299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:52.492142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:11:52.551318 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d920-e593-4eed-b774-209189c5ffbc admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:52.554974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c769-d3c8-4e41-8e26-e7e2a13a148c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:52.555672 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c769-d3c8-4e41-8e26-e7e2a13a148c service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:52.556090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c769-d3c8-4e41-8e26-e7e2a13a148c service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:52.556372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c769-d3c8-4e41-8e26-e7e2a13a148c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:52.565708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4c769-d3c8-4e41-8e26-e7e2a13a148c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:52.567170 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4c769-d3c8-4e41-8e26-e7e2a13a148c service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:52.576859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1272/2534] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:11:52.814047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7cd9c-7c87-4acf-b7bf-69b43c9307ce None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:11:52.824273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7cd9c-7c87-4acf-b7bf-69b43c9307ce None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:11:52.827786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:11:52.828425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:11:52.828708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:11:52.828977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:11:52.895467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:11:52.897591 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:11:52.906122 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1263/2535] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:00.117705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c769-d3c8-4e41-8e26-e7e2a13a148c service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:00.184209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c769-d3c8-4e41-8e26-e7e2a13a148c service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:00.189060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:00.190008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:00.190295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:00.190571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] PATH_INFO: `/v3/users/0c0276e836a34db7a45269df9ca57457` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:00.191780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0276e836a34db7a45269df9ca57457)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:00.193769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:00.459812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0276e836a34db7a45269df9ca57457'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.473496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0276e836a34db7a45269df9ca57457'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.474283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0276e836a34db7a45269df9ca57457'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.474939 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0276e836a34db7a45269df9ca57457'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.518218 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:00.519718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:00.533968 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96ea98-553a-47c0-8d61-acb8ff017858 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:00.538808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:00.539742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:00.539969 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:00.540261 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] PATH_INFO: `/v3/users/71322cd2abaf4cb4a8ca78f17de978b9` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:00.541511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=71322cd2abaf4cb4a8ca78f17de978b9)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:00.543461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:00.584771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-188308c2-7c22-4ce1-b8ef-db635dc4c20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0276e836a34db7a45269df9ca57457'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.592322 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1273/2536] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:00 2022] DELETE /identity/v3/users/0c0276e836a34db7a45269df9ca57457 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:00.596601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65150c3-93b5-46e1-8315-f76bd2296d53 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:00.596897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65150c3-93b5-46e1-8315-f76bd2296d53 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:00.597179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65150c3-93b5-46e1-8315-f76bd2296d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:00.616440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b65150c3-93b5-46e1-8315-f76bd2296d53 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:00.617686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b65150c3-93b5-46e1-8315-f76bd2296d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:00.691945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1274/2537] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:00.700178 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65150c3-93b5-46e1-8315-f76bd2296d53 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:00.701624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b65150c3-93b5-46e1-8315-f76bd2296d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:00.762019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65150c3-93b5-46e1-8315-f76bd2296d53 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:00.765844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbab18-5c78-43c9-860c-d762f0975311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:00.766487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbab18-5c78-43c9-860c-d762f0975311 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:00.766793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbab18-5c78-43c9-860c-d762f0975311 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:00.767067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbab18-5c78-43c9-860c-d762f0975311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:00.776554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbab18-5c78-43c9-860c-d762f0975311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:00.778044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbab18-5c78-43c9-860c-d762f0975311 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:00.788051 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1275/2538] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:00.848148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71322cd2abaf4cb4a8ca78f17de978b9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.864545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71322cd2abaf4cb4a8ca78f17de978b9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.865627 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71322cd2abaf4cb4a8ca78f17de978b9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.867048 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71322cd2abaf4cb4a8ca78f17de978b9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.938741 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71322cd2abaf4cb4a8ca78f17de978b9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:00.952440 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1264/2539] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:00 2022] DELETE /identity/v3/users/71322cd2abaf4cb4a8ca78f17de978b9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:00.957115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62963-be57-47a2-abab-de2330631b51 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:00.957489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62963-be57-47a2-abab-de2330631b51 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:00.957773 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62963-be57-47a2-abab-de2330631b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:00.975527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-24f62963-be57-47a2-abab-de2330631b51 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:00.976720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-24f62963-be57-47a2-abab-de2330631b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:01.044175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1276/2540] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:01.059975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:01.062237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:01.143029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33693-1acf-4633-9569-b467f61186ec admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:01.147166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fabd0f-111e-4220-a474-d7654d8baf14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:01.147884 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabd0f-111e-4220-a474-d7654d8baf14 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:01.148171 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabd0f-111e-4220-a474-d7654d8baf14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:01.148447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fabd0f-111e-4220-a474-d7654d8baf14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:01.168019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fabd0f-111e-4220-a474-d7654d8baf14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:01.169509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fabd0f-111e-4220-a474-d7654d8baf14 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:01.179796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1265/2541] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:01.784846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f62963-be57-47a2-abab-de2330631b51 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:01.786348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-24f62963-be57-47a2-abab-de2330631b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:01.799209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f62963-be57-47a2-abab-de2330631b51 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:01.804068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:01.804943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:01.805608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:01.805608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] PATH_INFO: `/v3/projects/98dbb538e06342e89de9bfab663e0967` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:01.807058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98dbb538e06342e89de9bfab663e0967)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:01.809060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:01.945630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98dbb538e06342e89de9bfab663e0967', 'request_id': 'req-60a9614a-071b-41ee-a9a0-d8d95183703f'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.013517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98dbb538e06342e89de9bfab663e0967', 'request_id': 'req-60a9614a-071b-41ee-a9a0-d8d95183703f'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.020484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98dbb538e06342e89de9bfab663e0967', 'request_id': 'req-60a9614a-071b-41ee-a9a0-d8d95183703f'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.033201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] The token cache is being invalidate because project 98dbb538e06342e89de9bfab663e0967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:02.033530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.034187 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.039252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1277/2542] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:01 2022] DELETE /identity/v3/projects/98dbb538e06342e89de9bfab663e0967 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:02.043622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fabd0f-111e-4220-a474-d7654d8baf14 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:02.053880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fabd0f-111e-4220-a474-d7654d8baf14 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:02.101751 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:02.109651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:02.137573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:02.138638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:02.140526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:02.140526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] PATH_INFO: `/v3/users/20e61fda068f489e962c3ad3835aca3c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:02.142894 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e61fda068f489e962c3ad3835aca3c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:02.147596 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:02.195190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9614a-071b-41ee-a9a0-d8d95183703f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:02.200323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:02.201190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:02.201523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:02.201798 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] PATH_INFO: `/v3/projects/98fff03d1ced4b58a2560bca3bf0a850` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:02.203243 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=98fff03d1ced4b58a2560bca3bf0a850)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:02.205409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:02.349996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98fff03d1ced4b58a2560bca3bf0a850', 'request_id': 'req-c2a75c2c-176a-4015-b8f2-da242669cc4a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.362599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e61fda068f489e962c3ad3835aca3c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.377182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e61fda068f489e962c3ad3835aca3c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.378310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e61fda068f489e962c3ad3835aca3c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.379118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e61fda068f489e962c3ad3835aca3c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.425944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98fff03d1ced4b58a2560bca3bf0a850', 'request_id': 'req-c2a75c2c-176a-4015-b8f2-da242669cc4a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.432881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98fff03d1ced4b58a2560bca3bf0a850', 'request_id': 'req-c2a75c2c-176a-4015-b8f2-da242669cc4a'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.444301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] The token cache is being invalidate because project 98fff03d1ced4b58a2560bca3bf0a850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:02.444598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.445295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.447020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1278/2543] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:02 2022] DELETE /identity/v3/projects/98fff03d1ced4b58a2560bca3bf0a850 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:02.451562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:02.452947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:02.521615 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a75c2c-176a-4015-b8f2-da242669cc4a admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:02.521821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e61fda068f489e962c3ad3835aca3c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.527106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:02.527992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:02.528345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:02.528632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] PATH_INFO: `/v3/users/f2694ab87f314e06a04adfe42d479446` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:02.530101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2694ab87f314e06a04adfe42d479446)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:02.532007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:02.536332 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1266/2544] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:02 2022] DELETE /identity/v3/users/20e61fda068f489e962c3ad3835aca3c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:02.781973 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2694ab87f314e06a04adfe42d479446'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.799523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2694ab87f314e06a04adfe42d479446'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.800503 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2694ab87f314e06a04adfe42d479446'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.801344 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2694ab87f314e06a04adfe42d479446'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.876199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-88444dd1-d328-4cae-80c5-0583bb44e488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2694ab87f314e06a04adfe42d479446'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:02.896729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1279/2545] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:02 2022] DELETE /identity/v3/users/f2694ab87f314e06a04adfe42d479446 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:02.973740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:02.983707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:03.057190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41638-dfc4-4e82-8491-2dc96129023d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:03.116133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:03.117488 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.118775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.119365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] PATH_INFO: `/v3/projects/208f811543864f9eb9961a09935c1bcb` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.120755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=208f811543864f9eb9961a09935c1bcb)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:03.123647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:03.245963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208f811543864f9eb9961a09935c1bcb', 'request_id': 'req-1e8dc680-93d5-45e7-a719-6248a8765cab'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.367359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208f811543864f9eb9961a09935c1bcb', 'request_id': 'req-1e8dc680-93d5-45e7-a719-6248a8765cab'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.374602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208f811543864f9eb9961a09935c1bcb', 'request_id': 'req-1e8dc680-93d5-45e7-a719-6248a8765cab'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.387204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] The token cache is being invalidate because project 208f811543864f9eb9961a09935c1bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:03.387588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.388255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.389932 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1267/2546] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:02 2022] DELETE /identity/v3/projects/208f811543864f9eb9961a09935c1bcb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:03.395095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3c182-cdba-44a6-a19a-fedd7367e46a None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.395385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3c182-cdba-44a6-a19a-fedd7367e46a None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.395702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3c182-cdba-44a6-a19a-fedd7367e46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.415302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-2ee3c182-cdba-44a6-a19a-fedd7367e46a None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:03.416614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2ee3c182-cdba-44a6-a19a-fedd7367e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:03.462892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:03.464434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:03.485814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1280/2547] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:03.495238 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4aecb-1017-4235-8e15-858e63ed6527 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.495654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4aecb-1017-4235-8e15-858e63ed6527 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.496132 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4aecb-1017-4235-8e15-858e63ed6527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.517971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9fb4aecb-1017-4235-8e15-858e63ed6527 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:03.519278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9fb4aecb-1017-4235-8e15-858e63ed6527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:03.528372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1281/2548] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:03.532552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4aecb-1017-4235-8e15-858e63ed6527 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:03.539256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dc680-93d5-45e7-a719-6248a8765cab admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:03.542243 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4aecb-1017-4235-8e15-858e63ed6527 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:03.545093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:03.545987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.546273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.546550 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] PATH_INFO: `/v3/projects/3e9261ec73364f7184997dab9ed903c6` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.546997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:03.547652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.547779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9261ec73364f7184997dab9ed903c6)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:03.547937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.548214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.548963 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:03.549283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:03.549696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:03.550866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:03.563081 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1282/2549] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:12:03.567323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:03.577731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61237b-0f97-4c50-96ac-e36dc1eb2401 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:03.583547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52552dd-1756-4c85-aea6-c0f52c48c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:03.594696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52552dd-1756-4c85-aea6-c0f52c48c5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.594696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52552dd-1756-4c85-aea6-c0f52c48c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.594696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52552dd-1756-4c85-aea6-c0f52c48c5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.594696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52552dd-1756-4c85-aea6-c0f52c48c5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:03.594696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52552dd-1756-4c85-aea6-c0f52c48c5b3 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:03.715917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9261ec73364f7184997dab9ed903c6', 'request_id': 'req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.740448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1283/2550] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:03 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:03.747995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52552dd-1756-4c85-aea6-c0f52c48c5b3 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:03.807748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9261ec73364f7184997dab9ed903c6', 'request_id': 'req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.812369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52552dd-1756-4c85-aea6-c0f52c48c5b3 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:03.814394 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9261ec73364f7184997dab9ed903c6', 'request_id': 'req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.820211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:03.820211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.820211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.820211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.820744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:03.820744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:03.826855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] The token cache is being invalidate because project 3e9261ec73364f7184997dab9ed903c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:03.827183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.827820 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b218eeb7-b3d6-4884-98ac-0e2e5f408b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:03.829483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1268/2551] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:03 2022] DELETE /identity/v3/projects/3e9261ec73364f7184997dab9ed903c6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:03.834686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6c12-092a-4f02-ad6e-4520279db2f6 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.835173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6c12-092a-4f02-ad6e-4520279db2f6 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.835458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6c12-092a-4f02-ad6e-4520279db2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.855476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-3a4e6c12-092a-4f02-ad6e-4520279db2f6 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:03.856696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3a4e6c12-092a-4f02-ad6e-4520279db2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:03.869118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1269/2552] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:03.874465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711a29-52de-424c-b83d-7b50170fa067 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.874812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711a29-52de-424c-b83d-7b50170fa067 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.875153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711a29-52de-424c-b83d-7b50170fa067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.894564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-95711a29-52de-424c-b83d-7b50170fa067 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:03.895774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-95711a29-52de-424c-b83d-7b50170fa067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:03.904473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1270/2553] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:03.908619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95711a29-52de-424c-b83d-7b50170fa067 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:03.918297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95711a29-52de-424c-b83d-7b50170fa067 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:03.923272 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:03.923947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.929051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.929051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.929051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:03.929051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:03.929051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:03.939646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1271/2554] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:12:03.944024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:03.954075 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6c871-c7ab-45d6-8518-1a22213d8d09 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:03.959258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e929-a5f7-4759-b962-e682c311256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:03.959905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e929-a5f7-4759-b962-e682c311256d admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.960214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e929-a5f7-4759-b962-e682c311256d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.960415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1284/2555] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:03 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:03.960554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650e929-a5f7-4759-b962-e682c311256d admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.961266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650e929-a5f7-4759-b962-e682c311256d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:03.963807 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650e929-a5f7-4759-b962-e682c311256d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:03.969478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:03.969478 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:03.979152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3002a93-2715-4b6c-a5b8-17de1f9b3f33 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:03.983958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21df91-97fc-4681-a335-a499d796738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:03.984706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21df91-97fc-4681-a335-a499d796738b admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:03.984988 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21df91-97fc-4681-a335-a499d796738b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:03.985292 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21df91-97fc-4681-a335-a499d796738b admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:03.986022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21df91-97fc-4681-a335-a499d796738b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:03.987609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21df91-97fc-4681-a335-a499d796738b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:03.998296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1285/2556] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:04.002426 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21df91-97fc-4681-a335-a499d796738b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.013931 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21df91-97fc-4681-a335-a499d796738b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.018640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a2c15-7e0a-4f01-a283-65de1115f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.019287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2c15-7e0a-4f01-a283-65de1115f24b admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.019572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2c15-7e0a-4f01-a283-65de1115f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.019848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a2c15-7e0a-4f01-a283-65de1115f24b admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.020574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a2c15-7e0a-4f01-a283-65de1115f24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.022229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a2c15-7e0a-4f01-a283-65de1115f24b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:04.032791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1286/2557] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:04.036697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a2c15-7e0a-4f01-a283-65de1115f24b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.047181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a2c15-7e0a-4f01-a283-65de1115f24b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.051883 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0770ae-9f16-43e8-9f58-3c25dd5f41df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.052739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0770ae-9f16-43e8-9f58-3c25dd5f41df admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.053020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0770ae-9f16-43e8-9f58-3c25dd5f41df admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.053325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0770ae-9f16-43e8-9f58-3c25dd5f41df admin admin] PATH_INFO: `/v3/projects/fb879df3d0c04e22be08676884840286/users/086578e96a76410e8ce4ecbc40758661/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.068543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0770ae-9f16-43e8-9f58-3c25dd5f41df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb879df3d0c04e22be08676884840286, user_id=086578e96a76410e8ce4ecbc40758661, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.075417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0770ae-9f16-43e8-9f58-3c25dd5f41df admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:04.075542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1272/2558] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:03 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:04.076901 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e929-a5f7-4759-b962-e682c311256d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.144307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650e929-a5f7-4759-b962-e682c311256d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.150061 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2c81-e6ae-4a26-b0cd-3726fad5500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.150745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2c81-e6ae-4a26-b0cd-3726fad5500d admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.151027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2c81-e6ae-4a26-b0cd-3726fad5500d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.151296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2c81-e6ae-4a26-b0cd-3726fad5500d admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.153446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad2c81-e6ae-4a26-b0cd-3726fad5500d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.154025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad2c81-e6ae-4a26-b0cd-3726fad5500d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:04.176118 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1287/2559] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:04 2022] PUT /identity/v3/projects/fb879df3d0c04e22be08676884840286/users/086578e96a76410e8ce4ecbc40758661/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:04.188361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4105-d480-43de-a2af-a16a3a3e445f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.188651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4105-d480-43de-a2af-a16a3a3e445f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.188936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4105-d480-43de-a2af-a16a3a3e445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.215925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a6da4105-d480-43de-a2af-a16a3a3e445f None None] MFA Rules not processed for user `086578e96a76410e8ce4ecbc40758661`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:04.217117 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a6da4105-d480-43de-a2af-a16a3a3e445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:04.247682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1273/2560] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:04 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:04.247682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2c81-e6ae-4a26-b0cd-3726fad5500d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.256693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2c81-e6ae-4a26-b0cd-3726fad5500d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.283137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1288/2561] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:04.294829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da4105-d480-43de-a2af-a16a3a3e445f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.296194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a6da4105-d480-43de-a2af-a16a3a3e445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:04.315673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4ea3d-bb12-4264-a85e-425046d8014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.316346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ea3d-bb12-4264-a85e-425046d8014d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.316631 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ea3d-bb12-4264-a85e-425046d8014d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.316910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ea3d-bb12-4264-a85e-425046d8014d admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.317676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4ea3d-bb12-4264-a85e-425046d8014d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.319291 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4ea3d-bb12-4264-a85e-425046d8014d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:04.329687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1274/2562] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:04.333737 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4ea3d-bb12-4264-a85e-425046d8014d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.344311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4ea3d-bb12-4264-a85e-425046d8014d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.349000 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3d69-4693-43a6-a331-a2b6ba572594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.349683 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3d69-4693-43a6-a331-a2b6ba572594 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.350056 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3d69-4693-43a6-a331-a2b6ba572594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.350235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3d69-4693-43a6-a331-a2b6ba572594 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.350965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3d69-4693-43a6-a331-a2b6ba572594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.353664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3d69-4693-43a6-a331-a2b6ba572594 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:04.355412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da4105-d480-43de-a2af-a16a3a3e445f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.359179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b666c-456c-4f5f-a923-57727bf8ae09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.359947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b666c-456c-4f5f-a923-57727bf8ae09 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.360231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b666c-456c-4f5f-a923-57727bf8ae09 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.360505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b666c-456c-4f5f-a923-57727bf8ae09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.363651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1275/2563] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:04.367738 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3d69-4693-43a6-a331-a2b6ba572594 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.369215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b666c-456c-4f5f-a923-57727bf8ae09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.370875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b666c-456c-4f5f-a923-57727bf8ae09 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:04.377839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3d69-4693-43a6-a331-a2b6ba572594 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.381311 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1289/2564] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:04.382933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1757f96-5377-43da-bc57-6d3383b8981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.384076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1757f96-5377-43da-bc57-6d3383b8981f admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.384356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1757f96-5377-43da-bc57-6d3383b8981f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.384633 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1757f96-5377-43da-bc57-6d3383b8981f admin admin] PATH_INFO: `/v3/projects/98557a5e420f4724bd939c77bee03124/users/c452a3603552481a819f6db1621046c0/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.402221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1757f96-5377-43da-bc57-6d3383b8981f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98557a5e420f4724bd939c77bee03124, user_id=c452a3603552481a819f6db1621046c0, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.404966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1757f96-5377-43da-bc57-6d3383b8981f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:04.513365 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1276/2565] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:04 2022] PUT /identity/v3/projects/98557a5e420f4724bd939c77bee03124/users/c452a3603552481a819f6db1621046c0/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:04.521435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a423-2136-446e-8639-ec62e0f48c94 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.521804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a423-2136-446e-8639-ec62e0f48c94 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.522348 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a423-2136-446e-8639-ec62e0f48c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.551340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-0212a423-2136-446e-8639-ec62e0f48c94 None None] MFA Rules not processed for user `c452a3603552481a819f6db1621046c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:04.552553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0212a423-2136-446e-8639-ec62e0f48c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:04.622025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1290/2566] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:04.626573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1757f96-5377-43da-bc57-6d3383b8981f admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.696619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1757f96-5377-43da-bc57-6d3383b8981f admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.702137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b62303-30d9-4231-8128-6f03d2bf4348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.702824 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62303-30d9-4231-8128-6f03d2bf4348 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.703068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62303-30d9-4231-8128-6f03d2bf4348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.703342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b62303-30d9-4231-8128-6f03d2bf4348 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.704059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b62303-30d9-4231-8128-6f03d2bf4348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.706014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b62303-30d9-4231-8128-6f03d2bf4348 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:04.835935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1277/2567] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:04 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:04.841642 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a423-2136-446e-8639-ec62e0f48c94 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:04.858435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a423-2136-446e-8639-ec62e0f48c94 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:04.933459 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f3b0-d665-4574-bf1a-c9fc514d072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:04.934241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f3b0-d665-4574-bf1a-c9fc514d072b admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:04.934530 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f3b0-d665-4574-bf1a-c9fc514d072b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:04.934836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f3b0-d665-4574-bf1a-c9fc514d072b admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:04.935603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f3b0-d665-4574-bf1a-c9fc514d072b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:04.937753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f3b0-d665-4574-bf1a-c9fc514d072b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:05.053586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1291/2568] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:04 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:05.056976 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b62303-30d9-4231-8128-6f03d2bf4348 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:05.069280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b62303-30d9-4231-8128-6f03d2bf4348 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:05.074873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db111d13-87d1-418c-bc96-bb16e165ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:05.075646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111d13-87d1-418c-bc96-bb16e165ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:05.076253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111d13-87d1-418c-bc96-bb16e165ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:05.076392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111d13-87d1-418c-bc96-bb16e165ce36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:05.077146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db111d13-87d1-418c-bc96-bb16e165ce36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:05.078916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db111d13-87d1-418c-bc96-bb16e165ce36 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:05.094957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1278/2569] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:05.097250 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f3b0-d665-4574-bf1a-c9fc514d072b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:05.111271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f3b0-d665-4574-bf1a-c9fc514d072b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:05.116453 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:05.117399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:05.118403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:05.118697 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] PATH_INFO: `/v3/projects/fea88d777fc247489e312316710eba5c/users/7fc2b7369049464b8a98cf457ad2342b/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:05.157354 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea88d777fc247489e312316710eba5c, user_id=7fc2b7369049464b8a98cf457ad2342b, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:05.161277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:05.257627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1292/2570] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:05 2022] PUT /identity/v3/projects/fea88d777fc247489e312316710eba5c/users/7fc2b7369049464b8a98cf457ad2342b/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:05.262728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db111d13-87d1-418c-bc96-bb16e165ce36 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:05.273522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db111d13-87d1-418c-bc96-bb16e165ce36 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:05.275753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:05.277477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:05.337199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86883d-3cba-4faf-ba3a-ed20fcce54a3 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:05.341276 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:05.341948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:05.342270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:05.342374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1204b-fdf6-4be9-b248-4e97fe8fcb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:05.342551 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:05.343531 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1204b-fdf6-4be9-b248-4e97fe8fcb8b admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:05.343959 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1204b-fdf6-4be9-b248-4e97fe8fcb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:05.344672 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:05.344892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1204b-fdf6-4be9-b248-4e97fe8fcb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:05.346144 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1204b-fdf6-4be9-b248-4e97fe8fcb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:05.348042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1204b-fdf6-4be9-b248-4e97fe8fcb8b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:05.361275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1279/2571] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:05.365599 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1204b-fdf6-4be9-b248-4e97fe8fcb8b admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:05.382804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1204b-fdf6-4be9-b248-4e97fe8fcb8b admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:05.388532 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59716b4b-d644-4bff-a5f6-159e14630174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:05.393263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716b4b-d644-4bff-a5f6-159e14630174 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:05.393263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716b4b-d644-4bff-a5f6-159e14630174 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:05.393263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59716b4b-d644-4bff-a5f6-159e14630174 admin admin] PATH_INFO: `/v3/projects/fea88d777fc247489e312316710eba5c/users/7fc2b7369049464b8a98cf457ad2342b/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:05.393263 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59716b4b-d644-4bff-a5f6-159e14630174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea88d777fc247489e312316710eba5c, user_id=7fc2b7369049464b8a98cf457ad2342b, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:05.394849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59716b4b-d644-4bff-a5f6-159e14630174 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:05.408128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1280/2572] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:05 2022] PUT /identity/v3/projects/fea88d777fc247489e312316710eba5c/users/7fc2b7369049464b8a98cf457ad2342b/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:05.417976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:05.422514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dddd5f-2cfb-4c6f-bbc0-0433f288ae0e None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:05.422687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:05.422830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dddd5f-2cfb-4c6f-bbc0-0433f288ae0e None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:05.422830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dddd5f-2cfb-4c6f-bbc0-0433f288ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:05.431171 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1293/2573] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:05.450229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-f7dddd5f-2cfb-4c6f-bbc0-0433f288ae0e None None] MFA Rules not processed for user `7fc2b7369049464b8a98cf457ad2342b`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:05.451507 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f7dddd5f-2cfb-4c6f-bbc0-0433f288ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:05.536575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1281/2574] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:05.548703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:05.603980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666341c1-f0bb-460e-a2e9-2ccafa10be72 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:05.660513 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13272a-d8d7-47b2-9546-413a83cd664b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:05.661768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13272a-d8d7-47b2-9546-413a83cd664b service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:05.662277 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13272a-d8d7-47b2-9546-413a83cd664b service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:05.662770 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13272a-d8d7-47b2-9546-413a83cd664b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:05.674009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13272a-d8d7-47b2-9546-413a83cd664b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:05.675622 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13272a-d8d7-47b2-9546-413a83cd664b service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:05.686364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1294/2575] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:06.938686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dddd5f-2cfb-4c6f-bbc0-0433f288ae0e None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:07.004939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dddd5f-2cfb-4c6f-bbc0-0433f288ae0e None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:07.011050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:07.026366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:07.026366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:07.026366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] PATH_INFO: `/v3/users/c452a3603552481a819f6db1621046c0` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:07.026366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c452a3603552481a819f6db1621046c0)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:07.026366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:07.302103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c452a3603552481a819f6db1621046c0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:07.315473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c452a3603552481a819f6db1621046c0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:07.316197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c452a3603552481a819f6db1621046c0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:07.316799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c452a3603552481a819f6db1621046c0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:07.400855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c452a3603552481a819f6db1621046c0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:07.414374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1282/2576] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:06 2022] DELETE /identity/v3/users/c452a3603552481a819f6db1621046c0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:07.419997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966adb-ec86-47f6-b333-fde3702dba2c None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:07.420473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966adb-ec86-47f6-b333-fde3702dba2c None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:07.420907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966adb-ec86-47f6-b333-fde3702dba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:07.439327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-96966adb-ec86-47f6-b333-fde3702dba2c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:07.440534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-96966adb-ec86-47f6-b333-fde3702dba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:07.504638 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1295/2577] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:07.511870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:07.513321 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:07.581139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9069-e71d-48d9-b1c7-c6a3616791f4 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:07.584751 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2efc1f-a978-47a7-b077-0d31e627c6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:07.585431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2efc1f-a978-47a7-b077-0d31e627c6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:07.585712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2efc1f-a978-47a7-b077-0d31e627c6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:07.585990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2efc1f-a978-47a7-b077-0d31e627c6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:07.596373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2efc1f-a978-47a7-b077-0d31e627c6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:07.603405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2efc1f-a978-47a7-b077-0d31e627c6a1 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:07.608724 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1283/2578] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:08.135182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96966adb-ec86-47f6-b333-fde3702dba2c None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:08.136848 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-96966adb-ec86-47f6-b333-fde3702dba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:08.150941 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96966adb-ec86-47f6-b333-fde3702dba2c None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:08.156407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:08.157489 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:08.157824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:08.158038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] PATH_INFO: `/v3/projects/98557a5e420f4724bd939c77bee03124` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:08.159681 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98557a5e420f4724bd939c77bee03124)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:08.161891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:08.350632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98557a5e420f4724bd939c77bee03124', 'request_id': 'req-010e1e6c-5832-421a-8c34-586f2e4824b3'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.441467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98557a5e420f4724bd939c77bee03124', 'request_id': 'req-010e1e6c-5832-421a-8c34-586f2e4824b3'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.448966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98557a5e420f4724bd939c77bee03124', 'request_id': 'req-010e1e6c-5832-421a-8c34-586f2e4824b3'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.460984 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] The token cache is being invalidate because project 98557a5e420f4724bd939c77bee03124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:08.461309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.462543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.464296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1296/2579] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:08 2022] DELETE /identity/v3/projects/98557a5e420f4724bd939c77bee03124 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:08.468457 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2efc1f-a978-47a7-b077-0d31e627c6a1 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:08.478818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2efc1f-a978-47a7-b077-0d31e627c6a1 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:08.540111 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:08.541354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:08.541638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:08.541937 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] PATH_INFO: `/v3/users/7fc2b7369049464b8a98cf457ad2342b` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:08.543268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc2b7369049464b8a98cf457ad2342b)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:08.545313 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:08.825201 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc2b7369049464b8a98cf457ad2342b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.837685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc2b7369049464b8a98cf457ad2342b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.838373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc2b7369049464b8a98cf457ad2342b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.838972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc2b7369049464b8a98cf457ad2342b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.942929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-85b143ed-4ca2-498c-b96f-8de6a392c8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc2b7369049464b8a98cf457ad2342b'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:08.956224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1284/2580] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:08 2022] DELETE /identity/v3/users/7fc2b7369049464b8a98cf457ad2342b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:09.519558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:09.521543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:09.536315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e1e6c-5832-421a-8c34-586f2e4824b3 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:09.600315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:09.601188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:09.601529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:09.601805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] PATH_INFO: `/v3/projects/fea88d777fc247489e312316710eba5c` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:09.604311 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea88d777fc247489e312316710eba5c)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:09.606258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:09.812463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea88d777fc247489e312316710eba5c', 'request_id': 'req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:09.926083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea88d777fc247489e312316710eba5c', 'request_id': 'req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:09.933320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea88d777fc247489e312316710eba5c', 'request_id': 'req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:09.944919 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] The token cache is being invalidate because project fea88d777fc247489e312316710eba5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:09.945216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:09.946621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-c8b67a02-726c-4eac-b6cd-d95aa96f3bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:09.948540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1297/2581] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:09 2022] DELETE /identity/v3/projects/fea88d777fc247489e312316710eba5c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:09.953426 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edb146-f4a9-415c-ba7d-0bc851e3ac16 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:09.953927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edb146-f4a9-415c-ba7d-0bc851e3ac16 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:09.954087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edb146-f4a9-415c-ba7d-0bc851e3ac16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:09.973556 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-c2edb146-f4a9-415c-ba7d-0bc851e3ac16 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:09.974771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c2edb146-f4a9-415c-ba7d-0bc851e3ac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:10.041188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1285/2582] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:10.049158 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4e98-0729-41d9-9815-b5e8cdd82fd0 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:10.049510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4e98-0729-41d9-9815-b5e8cdd82fd0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:10.049796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4e98-0729-41d9-9815-b5e8cdd82fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:10.068959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5b5e4e98-0729-41d9-9815-b5e8cdd82fd0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:10.070217 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5b5e4e98-0729-41d9-9815-b5e8cdd82fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:10.080074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1298/2583] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:10.084324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edb146-f4a9-415c-ba7d-0bc851e3ac16 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:10.095281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edb146-f4a9-415c-ba7d-0bc851e3ac16 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:10.099979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:10.100651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:10.100934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:10.101210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:10.101991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:10.103016 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:10.104646 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:10.120112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1286/2584] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:12:10.121201 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4e98-0729-41d9-9815-b5e8cdd82fd0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:10.130465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4e98-0729-41d9-9815-b5e8cdd82fd0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:10.136738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d86fb-a72b-403e-ab56-8e3768e9ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:10.142611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d86fb-a72b-403e-ab56-8e3768e9ca9c admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:10.142611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d86fb-a72b-403e-ab56-8e3768e9ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:10.142611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d86fb-a72b-403e-ab56-8e3768e9ca9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:10.142611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d86fb-a72b-403e-ab56-8e3768e9ca9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:10.142611 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d86fb-a72b-403e-ab56-8e3768e9ca9c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:10.227820 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1299/2585] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:10 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:10.257592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:10.264290 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3957a06-9bfd-462d-acc9-efce57f74f34 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:10.330102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b643-6565-4093-92e4-f718e922b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:10.330827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b643-6565-4093-92e4-f718e922b4da admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:10.331066 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b643-6565-4093-92e4-f718e922b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:10.331424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b643-6565-4093-92e4-f718e922b4da admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:10.332172 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700b643-6565-4093-92e4-f718e922b4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:10.334186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700b643-6565-4093-92e4-f718e922b4da admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:10.665876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1287/2586] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:10 2022] POST /identity/v3/users => generated 288 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:10.671133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d86fb-a72b-403e-ab56-8e3768e9ca9c admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:10.682731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d86fb-a72b-403e-ab56-8e3768e9ca9c admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:10.687819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f232f-2dc3-4c50-b278-1b54386abfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:10.688491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f232f-2dc3-4c50-b278-1b54386abfdc admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:10.688774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f232f-2dc3-4c50-b278-1b54386abfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:10.689048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f232f-2dc3-4c50-b278-1b54386abfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:10.689829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f232f-2dc3-4c50-b278-1b54386abfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:10.691523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f232f-2dc3-4c50-b278-1b54386abfdc admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:10.702845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1300/2587] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:10.709484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b643-6565-4093-92e4-f718e922b4da admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:10.719955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b643-6565-4093-92e4-f718e922b4da admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:10.724484 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20e7df-b34d-4fb7-95e6-547fb323623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:10.725137 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e7df-b34d-4fb7-95e6-547fb323623b admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:10.725473 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e7df-b34d-4fb7-95e6-547fb323623b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:10.725835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20e7df-b34d-4fb7-95e6-547fb323623b admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:10.726564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20e7df-b34d-4fb7-95e6-547fb323623b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:10.728686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20e7df-b34d-4fb7-95e6-547fb323623b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:10.738803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1288/2588] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:10.744003 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f232f-2dc3-4c50-b278-1b54386abfdc admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:10.754198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f232f-2dc3-4c50-b278-1b54386abfdc admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:10.759758 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56745da2-20b1-47a6-8833-89ec7a309dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:10.760218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56745da2-20b1-47a6-8833-89ec7a309dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:10.760526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56745da2-20b1-47a6-8833-89ec7a309dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:10.760801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56745da2-20b1-47a6-8833-89ec7a309dd8 admin admin] PATH_INFO: `/v3/projects/5271252f74454b4dbf5b781663ef7f78/users/998c34eba26040188396e7b76d68f4f7/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:10.776008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56745da2-20b1-47a6-8833-89ec7a309dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5271252f74454b4dbf5b781663ef7f78, user_id=998c34eba26040188396e7b76d68f4f7, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:10.778683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56745da2-20b1-47a6-8833-89ec7a309dd8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:10.933284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1301/2589] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:10 2022] PUT /identity/v3/projects/5271252f74454b4dbf5b781663ef7f78/users/998c34eba26040188396e7b76d68f4f7/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:10.943975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c3e07-e7ad-47b7-ba99-e869e73573b5 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:10.944260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c3e07-e7ad-47b7-ba99-e869e73573b5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:10.944545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c3e07-e7ad-47b7-ba99-e869e73573b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:10.971582 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a95c3e07-e7ad-47b7-ba99-e869e73573b5 None None] MFA Rules not processed for user `998c34eba26040188396e7b76d68f4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:10.973841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a95c3e07-e7ad-47b7-ba99-e869e73573b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:11.038897 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1289/2590] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:11.044331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56745da2-20b1-47a6-8833-89ec7a309dd8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:11.115008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56745da2-20b1-47a6-8833-89ec7a309dd8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:11.120261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87af4c-12d8-4f48-b645-cf3d4d5d5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:11.121264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87af4c-12d8-4f48-b645-cf3d4d5d5c48 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:11.121264 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87af4c-12d8-4f48-b645-cf3d4d5d5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:11.121469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87af4c-12d8-4f48-b645-cf3d4d5d5c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:11.122157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87af4c-12d8-4f48-b645-cf3d4d5d5c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:11.124056 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87af4c-12d8-4f48-b645-cf3d4d5d5c48 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:11.207633 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1302/2591] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:11 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:11.212382 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c3e07-e7ad-47b7-ba99-e869e73573b5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:11.223051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c3e07-e7ad-47b7-ba99-e869e73573b5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:11.282446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27630cb-9484-4ab7-9a29-7f5f369bb979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:11.283133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27630cb-9484-4ab7-9a29-7f5f369bb979 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:11.283415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27630cb-9484-4ab7-9a29-7f5f369bb979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:11.283818 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27630cb-9484-4ab7-9a29-7f5f369bb979 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:11.284444 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27630cb-9484-4ab7-9a29-7f5f369bb979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:11.286435 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27630cb-9484-4ab7-9a29-7f5f369bb979 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:11.396235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1290/2592] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:11 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:11.401172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87af4c-12d8-4f48-b645-cf3d4d5d5c48 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:11.411640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87af4c-12d8-4f48-b645-cf3d4d5d5c48 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:11.416767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac3cba-5c57-44d7-ba40-b250ed50b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:11.417465 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3cba-5c57-44d7-ba40-b250ed50b72c admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:11.417754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3cba-5c57-44d7-ba40-b250ed50b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:11.418037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3cba-5c57-44d7-ba40-b250ed50b72c admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:11.418768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac3cba-5c57-44d7-ba40-b250ed50b72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:11.420360 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac3cba-5c57-44d7-ba40-b250ed50b72c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:11.431424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1303/2593] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:11.435985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27630cb-9484-4ab7-9a29-7f5f369bb979 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:11.446626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27630cb-9484-4ab7-9a29-7f5f369bb979 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:11.451902 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6997f-7716-4f7b-9c7d-dc92ac80ed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:11.455637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6997f-7716-4f7b-9c7d-dc92ac80ed7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:11.455637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6997f-7716-4f7b-9c7d-dc92ac80ed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:11.455637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6997f-7716-4f7b-9c7d-dc92ac80ed7e admin admin] PATH_INFO: `/v3/projects/d1ff0cdba88740a0b7595b929dcd1b0e/users/4442e951e40e404894ed88db04b83231/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:11.471621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6997f-7716-4f7b-9c7d-dc92ac80ed7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ff0cdba88740a0b7595b929dcd1b0e, user_id=4442e951e40e404894ed88db04b83231, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:11.474536 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6997f-7716-4f7b-9c7d-dc92ac80ed7e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:11.635545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1291/2594] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:11 2022] PUT /identity/v3/projects/d1ff0cdba88740a0b7595b929dcd1b0e/users/4442e951e40e404894ed88db04b83231/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:11.638928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac3cba-5c57-44d7-ba40-b250ed50b72c admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:11.650535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac3cba-5c57-44d7-ba40-b250ed50b72c admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:11.719394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109176ad-22f1-44a4-a0c1-70c3ee414d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:11.720244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109176ad-22f1-44a4-a0c1-70c3ee414d5d admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:11.720448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109176ad-22f1-44a4-a0c1-70c3ee414d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:11.720678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109176ad-22f1-44a4-a0c1-70c3ee414d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:11.721440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109176ad-22f1-44a4-a0c1-70c3ee414d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:11.723075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109176ad-22f1-44a4-a0c1-70c3ee414d5d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:11.737769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1304/2595] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:11.739024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6997f-7716-4f7b-9c7d-dc92ac80ed7e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:11.751907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6997f-7716-4f7b-9c7d-dc92ac80ed7e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:11.758223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:11.759863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:11.760230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:11.760613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] PATH_INFO: `/v3/projects/d1ff0cdba88740a0b7595b929dcd1b0e/users/4442e951e40e404894ed88db04b83231/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:11.762702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ff0cdba88740a0b7595b929dcd1b0e, user_id=4442e951e40e404894ed88db04b83231, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:11.765586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:11.777156 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1292/2596] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:11 2022] PUT /identity/v3/projects/d1ff0cdba88740a0b7595b929dcd1b0e/users/4442e951e40e404894ed88db04b83231/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:11.788544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bb65f-902f-41d0-a272-f7e04ffd7992 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:11.788833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bb65f-902f-41d0-a272-f7e04ffd7992 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:11.789160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bb65f-902f-41d0-a272-f7e04ffd7992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:11.816994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5c1bb65f-902f-41d0-a272-f7e04ffd7992 None None] MFA Rules not processed for user `4442e951e40e404894ed88db04b83231`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:11.821980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5c1bb65f-902f-41d0-a272-f7e04ffd7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:11.892223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1305/2597] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:11.906392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:11.908156 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:11.970788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2a734-1eaf-4f8f-9f17-8ed2f105f270 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:11.975990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:11.976712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:11.977001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:11.978083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:12.035946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:12.037459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:12.047604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1293/2598] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:13.358881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bb65f-902f-41d0-a272-f7e04ffd7992 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:13.360417 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5c1bb65f-902f-41d0-a272-f7e04ffd7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:13.420886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bb65f-902f-41d0-a272-f7e04ffd7992 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:13.424874 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62c124-48e9-48f5-897e-b5f11e42777d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:13.425559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62c124-48e9-48f5-897e-b5f11e42777d service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:13.426375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62c124-48e9-48f5-897e-b5f11e42777d service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:13.426375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62c124-48e9-48f5-897e-b5f11e42777d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:13.427827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-fa62c124-48e9-48f5-897e-b5f11e42777d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:13.490670 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62c124-48e9-48f5-897e-b5f11e42777d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:13.498106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62c124-48e9-48f5-897e-b5f11e42777d service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:13.502681 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1306/2599] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:15.582972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:15.584383 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:15.601205 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7bac5-015c-44be-a74e-eb78fd4b99c6 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:15.607991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:15.655311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:15.655311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:15.655311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] PATH_INFO: `/v3/users/086578e96a76410e8ce4ecbc40758661` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:15.655311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] RBAC: Authorizing `identity:delete_user(user_id=086578e96a76410e8ce4ecbc40758661)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:15.655311 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:15.944847 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086578e96a76410e8ce4ecbc40758661'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:15.970594 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086578e96a76410e8ce4ecbc40758661'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:15.972050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086578e96a76410e8ce4ecbc40758661'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:15.973375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086578e96a76410e8ce4ecbc40758661'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:16.064723 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086578e96a76410e8ce4ecbc40758661'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:16.080489 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1294/2600] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:15 2022] DELETE /identity/v3/users/086578e96a76410e8ce4ecbc40758661 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:16.085162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358c5f2-1a63-4bc6-9ab2-0bea47df0df1 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:16.085753 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358c5f2-1a63-4bc6-9ab2-0bea47df0df1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:16.086332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358c5f2-1a63-4bc6-9ab2-0bea47df0df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:16.109768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1358c5f2-1a63-4bc6-9ab2-0bea47df0df1 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:16.109768 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1358c5f2-1a63-4bc6-9ab2-0bea47df0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:16.169415 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1307/2601] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:16.179742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:16.182072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:16.255719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394674e-01bc-429f-8d3e-2f82c50b472d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:16.259974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb55c5-8f2f-4999-a15a-d22df847aa09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:16.260634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb55c5-8f2f-4999-a15a-d22df847aa09 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:16.260920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb55c5-8f2f-4999-a15a-d22df847aa09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:16.261258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb55c5-8f2f-4999-a15a-d22df847aa09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:16.272184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb55c5-8f2f-4999-a15a-d22df847aa09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:16.273634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb55c5-8f2f-4999-a15a-d22df847aa09 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:16.285560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1295/2602] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:16.911890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358c5f2-1a63-4bc6-9ab2-0bea47df0df1 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:16.917446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1358c5f2-1a63-4bc6-9ab2-0bea47df0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:16.927145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358c5f2-1a63-4bc6-9ab2-0bea47df0df1 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:16.932837 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:16.933781 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:16.934111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:16.934413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] PATH_INFO: `/v3/projects/fb879df3d0c04e22be08676884840286` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:16.935948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb879df3d0c04e22be08676884840286)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:16.937924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:17.102416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb879df3d0c04e22be08676884840286', 'request_id': 'req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:17.206979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb879df3d0c04e22be08676884840286', 'request_id': 'req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:17.215324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb879df3d0c04e22be08676884840286', 'request_id': 'req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:17.230952 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] The token cache is being invalidate because project fb879df3d0c04e22be08676884840286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:17.231559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:17.232497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7a1d8a2b-e66d-4279-a0e7-3fa1037fad5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:17.234748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1308/2603] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:16 2022] DELETE /identity/v3/projects/fb879df3d0c04e22be08676884840286 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:17.245318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9706-26b7-4187-ae78-ec359cf810e7 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.245318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9706-26b7-4187-ae78-ec359cf810e7 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.245318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d9706-26b7-4187-ae78-ec359cf810e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.263504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-726d9706-26b7-4187-ae78-ec359cf810e7 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:17.264994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-726d9706-26b7-4187-ae78-ec359cf810e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:17.340483 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1296/2604] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:17.348522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fab1-f2d4-4828-b099-b90760d590c4 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.348908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fab1-f2d4-4828-b099-b90760d590c4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.349085 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162fab1-f2d4-4828-b099-b90760d590c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.370930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-e162fab1-f2d4-4828-b099-b90760d590c4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:17.372427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-e162fab1-f2d4-4828-b099-b90760d590c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:17.381311 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1309/2605] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:17.386475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d9706-26b7-4187-ae78-ec359cf810e7 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:17.396700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d9706-26b7-4187-ae78-ec359cf810e7 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:17.401776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:17.402450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.402730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.402999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.403933 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:17.404241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:17.406227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:17.420214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1297/2606] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:12:17.424639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162fab1-f2d4-4828-b099-b90760d590c4 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:17.435012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162fab1-f2d4-4828-b099-b90760d590c4 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:17.440913 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd81c55-33c2-40e4-b664-092d4a805613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:17.441626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd81c55-33c2-40e4-b664-092d4a805613 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.441908 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd81c55-33c2-40e4-b664-092d4a805613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.442180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd81c55-33c2-40e4-b664-092d4a805613 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.442875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd81c55-33c2-40e4-b664-092d4a805613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:17.445071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd81c55-33c2-40e4-b664-092d4a805613 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:17.576411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1310/2607] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:17 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:17.580718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:17.591364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d104c-ce4c-495a-89a4-fa70b0ac3b53 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:17.674647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a2535-294a-441a-8a61-48cce0ddf426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:17.675327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a2535-294a-441a-8a61-48cce0ddf426 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.675681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a2535-294a-441a-8a61-48cce0ddf426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.675885 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a2535-294a-441a-8a61-48cce0ddf426 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.676616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a2535-294a-441a-8a61-48cce0ddf426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:17.678558 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a2535-294a-441a-8a61-48cce0ddf426 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:17.779329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1298/2608] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:17 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:17.783701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd81c55-33c2-40e4-b664-092d4a805613 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:17.794832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd81c55-33c2-40e4-b664-092d4a805613 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:17.799505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5efcb-f40a-4477-841b-e46e3fb6918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:17.800350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5efcb-f40a-4477-841b-e46e3fb6918c admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.800536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5efcb-f40a-4477-841b-e46e3fb6918c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.801340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5efcb-f40a-4477-841b-e46e3fb6918c admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.805058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5efcb-f40a-4477-841b-e46e3fb6918c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:17.805058 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5efcb-f40a-4477-841b-e46e3fb6918c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:17.815208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1311/2609] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:17.819606 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a2535-294a-441a-8a61-48cce0ddf426 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:17.829886 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a2535-294a-441a-8a61-48cce0ddf426 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:17.834693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:17.839504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.839504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.839504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.839504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:17.839504 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:17.849423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1299/2610] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:17.853872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5efcb-f40a-4477-841b-e46e3fb6918c admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:17.863728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5efcb-f40a-4477-841b-e46e3fb6918c admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:17.869126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464d1f2-20ff-4861-8eb1-c2d609e4c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:17.870024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d1f2-20ff-4861-8eb1-c2d609e4c484 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.873801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d1f2-20ff-4861-8eb1-c2d609e4c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.873801 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d1f2-20ff-4861-8eb1-c2d609e4c484 admin admin] PATH_INFO: `/v3/projects/2fbc65e323204179bedb61d709caed21/users/a41697666e4d41b8a362d18e539facd9/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.886552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464d1f2-20ff-4861-8eb1-c2d609e4c484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbc65e323204179bedb61d709caed21, user_id=a41697666e4d41b8a362d18e539facd9, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:17.889296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464d1f2-20ff-4861-8eb1-c2d609e4c484 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:17.906005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:17.907918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:17.922860 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d375e3-5c83-48c5-800c-10fadd669ce2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:17.928482 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:17.929478 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.929761 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.930528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] PATH_INFO: `/v3/users/5987014231084f679a795a88f14ad02e` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.931802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5987014231084f679a795a88f14ad02e)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:17.933744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:17.961822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1312/2611] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:17 2022] PUT /identity/v3/projects/2fbc65e323204179bedb61d709caed21/users/a41697666e4d41b8a362d18e539facd9/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:17.967020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303ae2-4f71-4878-bd8b-d7e18b1b2581 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:17.967376 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303ae2-4f71-4878-bd8b-d7e18b1b2581 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:17.967724 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303ae2-4f71-4878-bd8b-d7e18b1b2581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:17.988271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-b7303ae2-4f71-4878-bd8b-d7e18b1b2581 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:17.989755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b7303ae2-4f71-4878-bd8b-d7e18b1b2581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:18.052422 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1313/2612] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:18.062819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7303ae2-4f71-4878-bd8b-d7e18b1b2581 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:18.064216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b7303ae2-4f71-4878-bd8b-d7e18b1b2581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:18.122689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7303ae2-4f71-4878-bd8b-d7e18b1b2581 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:18.126455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cf47f-7a96-4b1d-9fcc-cda3092e4599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:18.127102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cf47f-7a96-4b1d-9fcc-cda3092e4599 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:18.127387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cf47f-7a96-4b1d-9fcc-cda3092e4599 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:18.127658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cf47f-7a96-4b1d-9fcc-cda3092e4599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:18.137001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cf47f-7a96-4b1d-9fcc-cda3092e4599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:18.138455 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cf47f-7a96-4b1d-9fcc-cda3092e4599 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:18.148077 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1314/2613] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:18.199969 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5987014231084f679a795a88f14ad02e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:18.212158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5987014231084f679a795a88f14ad02e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:18.212842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5987014231084f679a795a88f14ad02e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:18.213490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5987014231084f679a795a88f14ad02e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:18.331415 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5987014231084f679a795a88f14ad02e'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:18.344419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1300/2614] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:17 2022] DELETE /identity/v3/users/5987014231084f679a795a88f14ad02e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:18.689189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cf47f-7a96-4b1d-9fcc-cda3092e4599 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:18.701504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cf47f-7a96-4b1d-9fcc-cda3092e4599 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:18.770594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:18.771494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:18.771775 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:18.772054 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] PATH_INFO: `/v3/projects/8e628b06a0ca4ee4bf45d04395a657ff` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:18.773272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e628b06a0ca4ee4bf45d04395a657ff)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:18.776428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:18.927728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e628b06a0ca4ee4bf45d04395a657ff', 'request_id': 'req-1e5e6289-4f70-4f48-9479-45a3f923c541'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:18.960664 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:18.962612 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:18.995625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e628b06a0ca4ee4bf45d04395a657ff', 'request_id': 'req-1e5e6289-4f70-4f48-9479-45a3f923c541'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:19.003080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e628b06a0ca4ee4bf45d04395a657ff', 'request_id': 'req-1e5e6289-4f70-4f48-9479-45a3f923c541'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:19.015388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] The token cache is being invalidate because project 8e628b06a0ca4ee4bf45d04395a657ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:19.015678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:19.016745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-1e5e6289-4f70-4f48-9479-45a3f923c541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:19.018329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1315/2615] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:18 2022] DELETE /identity/v3/projects/8e628b06a0ca4ee4bf45d04395a657ff => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:19.024325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebf0a-3951-4984-b6c8-d93eb1df1eb0 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.024805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebf0a-3951-4984-b6c8-d93eb1df1eb0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.025151 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebf0a-3951-4984-b6c8-d93eb1df1eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.026049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3035e9-b602-4cbd-a583-a0acdca4aed7 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.044860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-2c0ebf0a-3951-4984-b6c8-d93eb1df1eb0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:19.046192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-2c0ebf0a-3951-4984-b6c8-d93eb1df1eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:19.090013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.090675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.090957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.091230 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.093320 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:19.110115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1316/2616] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:19.118466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f875-8ed1-4ba2-b640-aecd93aaf4f0 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.118897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f875-8ed1-4ba2-b640-aecd93aaf4f0 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.119255 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f875-8ed1-4ba2-b640-aecd93aaf4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.139774 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-12c4f875-8ed1-4ba2-b640-aecd93aaf4f0 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:19.141046 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-12c4f875-8ed1-4ba2-b640-aecd93aaf4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:19.151131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1317/2617] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:19.155135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4f875-8ed1-4ba2-b640-aecd93aaf4f0 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:19.164180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4f875-8ed1-4ba2-b640-aecd93aaf4f0 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.166963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.168628 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:19.169738 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.170404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.170681 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.170974 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.171668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:19.172140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.173750 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:19.179017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1301/2618] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:19.185818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1318/2619] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:12:19.190083 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:19.201275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a33a5-37e3-4ab1-965c-7c142d84499f service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.207136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2830d-71f5-4014-bd5e-137d817565cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.208813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2830d-71f5-4014-bd5e-137d817565cc admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.208813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2830d-71f5-4014-bd5e-137d817565cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.208813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2830d-71f5-4014-bd5e-137d817565cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.209271 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2830d-71f5-4014-bd5e-137d817565cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.211125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2830d-71f5-4014-bd5e-137d817565cc admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:19.337575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1302/2620] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:19 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:19.339761 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:19.350261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e38ca-aaf2-4b60-81fc-0be104db9a1d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.409231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d790c44-e237-4a01-9d50-577ad9dc742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.409936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d790c44-e237-4a01-9d50-577ad9dc742b admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.410198 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d790c44-e237-4a01-9d50-577ad9dc742b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.410470 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d790c44-e237-4a01-9d50-577ad9dc742b admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.411161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d790c44-e237-4a01-9d50-577ad9dc742b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.413127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d790c44-e237-4a01-9d50-577ad9dc742b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:19.499524 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1319/2621] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:19 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:19.503623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2830d-71f5-4014-bd5e-137d817565cc admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:19.518008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2830d-71f5-4014-bd5e-137d817565cc admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.537776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c2a28-c098-43fe-8460-6e9c8af76451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.540235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2a28-c098-43fe-8460-6e9c8af76451 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.540235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2a28-c098-43fe-8460-6e9c8af76451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.540235 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2a28-c098-43fe-8460-6e9c8af76451 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.540999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c2a28-c098-43fe-8460-6e9c8af76451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.542836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c2a28-c098-43fe-8460-6e9c8af76451 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:19.554204 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1303/2622] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:19.558949 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d790c44-e237-4a01-9d50-577ad9dc742b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:19.569708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d790c44-e237-4a01-9d50-577ad9dc742b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.575307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8845af-9c10-4929-be03-b513565a8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.576007 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8845af-9c10-4929-be03-b513565a8415 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.576410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8845af-9c10-4929-be03-b513565a8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.576689 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8845af-9c10-4929-be03-b513565a8415 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.577458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8845af-9c10-4929-be03-b513565a8415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.579145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8845af-9c10-4929-be03-b513565a8415 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:19.600544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1320/2623] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:19.602315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c2a28-c098-43fe-8460-6e9c8af76451 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:19.603872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc101c3-c0c2-4e5a-ae61-4274ccd56e40 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.604163 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc101c3-c0c2-4e5a-ae61-4274ccd56e40 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.604437 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc101c3-c0c2-4e5a-ae61-4274ccd56e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.610387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c2a28-c098-43fe-8460-6e9c8af76451 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.616607 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.618691 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.619407 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.624511 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] PATH_INFO: `/v3/projects/006034bfa58f4f78902cf0083eb91536/users/354d717d2ed745a19765659b3b342175/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.641032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-ecc101c3-c0c2-4e5a-ae61-4274ccd56e40 None None] MFA Rules not processed for user `a41697666e4d41b8a362d18e539facd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:19.643797 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ecc101c3-c0c2-4e5a-ae61-4274ccd56e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:19.647434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=006034bfa58f4f78902cf0083eb91536, user_id=354d717d2ed745a19765659b3b342175, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.647434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:19.717525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1321/2624] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:19.729296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1304/2625] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:19 2022] PUT /identity/v3/projects/006034bfa58f4f78902cf0083eb91536/users/354d717d2ed745a19765659b3b342175/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:19.736650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06506f-7a9e-4f89-a3e7-d1e3f8340c43 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.736947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06506f-7a9e-4f89-a3e7-d1e3f8340c43 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.737263 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06506f-7a9e-4f89-a3e7-d1e3f8340c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.738829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:19.747792 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:19.766562 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-6e06506f-7a9e-4f89-a3e7-d1e3f8340c43 None None] MFA Rules not processed for user `354d717d2ed745a19765659b3b342175`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:19.767792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6e06506f-7a9e-4f89-a3e7-d1e3f8340c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:19.810389 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27574bec-21c1-40ff-94a1-b01bbaa718ac admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.814277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbffd0-3227-45d3-8717-b1e1bd768ccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.814927 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbffd0-3227-45d3-8717-b1e1bd768ccc service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.815207 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbffd0-3227-45d3-8717-b1e1bd768ccc service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.815479 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbffd0-3227-45d3-8717-b1e1bd768ccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.835106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1322/2626] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:19.840203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06506f-7a9e-4f89-a3e7-d1e3f8340c43 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:19.883518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbffd0-3227-45d3-8717-b1e1bd768ccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.883518 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbffd0-3227-45d3-8717-b1e1bd768ccc service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:19.893150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1305/2627] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:19.921361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06506f-7a9e-4f89-a3e7-d1e3f8340c43 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:19.926229 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a5bd8-5f9c-40e3-a82f-222d039369de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:19.926904 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5bd8-5f9c-40e3-a82f-222d039369de admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:19.927206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5bd8-5f9c-40e3-a82f-222d039369de admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:19.927468 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a5bd8-5f9c-40e3-a82f-222d039369de admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:19.928236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a5bd8-5f9c-40e3-a82f-222d039369de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:19.933943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a5bd8-5f9c-40e3-a82f-222d039369de admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:20.007093 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1323/2628] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:19 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:20.011806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbffd0-3227-45d3-8717-b1e1bd768ccc service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:20.022374 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbffd0-3227-45d3-8717-b1e1bd768ccc service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:20.080711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f108-a140-4b43-92fd-ca02a6d5ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:20.081419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f108-a140-4b43-92fd-ca02a6d5ce94 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:20.081717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f108-a140-4b43-92fd-ca02a6d5ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:20.081993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f108-a140-4b43-92fd-ca02a6d5ce94 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:20.082685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1f108-a140-4b43-92fd-ca02a6d5ce94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:20.084722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1f108-a140-4b43-92fd-ca02a6d5ce94 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:20.177273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1306/2629] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:20 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:20.181906 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a5bd8-5f9c-40e3-a82f-222d039369de admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:20.192314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a5bd8-5f9c-40e3-a82f-222d039369de admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:20.198549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a43db-b7a8-41db-87e2-c60e26600746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:20.199211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a43db-b7a8-41db-87e2-c60e26600746 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:20.199497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a43db-b7a8-41db-87e2-c60e26600746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:20.199777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a43db-b7a8-41db-87e2-c60e26600746 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:20.200507 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a43db-b7a8-41db-87e2-c60e26600746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:20.202157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a43db-b7a8-41db-87e2-c60e26600746 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:20.213462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1324/2630] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:20.217634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f108-a140-4b43-92fd-ca02a6d5ce94 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:20.228269 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f108-a140-4b43-92fd-ca02a6d5ce94 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:20.232812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bdffa-6e3c-47ce-831a-8124a14e6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:20.233773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bdffa-6e3c-47ce-831a-8124a14e6ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:20.234051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bdffa-6e3c-47ce-831a-8124a14e6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:20.238851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bdffa-6e3c-47ce-831a-8124a14e6ecd admin admin] PATH_INFO: `/v3/projects/d862c5f46f864f9c823279a0db5966d2/users/c0735259f6184655a86c42a0e3928e53/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:20.249916 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bdffa-6e3c-47ce-831a-8124a14e6ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d862c5f46f864f9c823279a0db5966d2, user_id=c0735259f6184655a86c42a0e3928e53, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:20.252559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bdffa-6e3c-47ce-831a-8124a14e6ecd admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:20.349744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1307/2631] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:20 2022] PUT /identity/v3/projects/d862c5f46f864f9c823279a0db5966d2/users/c0735259f6184655a86c42a0e3928e53/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:20.354822 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a43db-b7a8-41db-87e2-c60e26600746 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:20.364765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a43db-b7a8-41db-87e2-c60e26600746 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:20.422630 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c176a-690a-4753-8df3-969839b201f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:20.423294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c176a-690a-4753-8df3-969839b201f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:20.423609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c176a-690a-4753-8df3-969839b201f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:20.423889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c176a-690a-4753-8df3-969839b201f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:20.424662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c176a-690a-4753-8df3-969839b201f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:20.426353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c176a-690a-4753-8df3-969839b201f4 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:20.440215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1325/2632] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:20.441425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bdffa-6e3c-47ce-831a-8124a14e6ecd admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:20.452187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bdffa-6e3c-47ce-831a-8124a14e6ecd admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:20.457425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55205b6b-4724-4345-96ad-1746a36c4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:20.458329 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55205b6b-4724-4345-96ad-1746a36c4789 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:20.458584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55205b6b-4724-4345-96ad-1746a36c4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:20.458855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55205b6b-4724-4345-96ad-1746a36c4789 admin admin] PATH_INFO: `/v3/projects/d862c5f46f864f9c823279a0db5966d2/users/c0735259f6184655a86c42a0e3928e53/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:20.460804 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55205b6b-4724-4345-96ad-1746a36c4789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d862c5f46f864f9c823279a0db5966d2, user_id=c0735259f6184655a86c42a0e3928e53, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:20.463472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55205b6b-4724-4345-96ad-1746a36c4789 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:20.475574 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1308/2633] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:20 2022] PUT /identity/v3/projects/d862c5f46f864f9c823279a0db5966d2/users/c0735259f6184655a86c42a0e3928e53/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:20.486374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe122-d7fd-4c8f-91a0-a744501f4e7f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:20.486643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe122-d7fd-4c8f-91a0-a744501f4e7f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:20.486924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe122-d7fd-4c8f-91a0-a744501f4e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:20.515588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1ccfe122-d7fd-4c8f-91a0-a744501f4e7f None None] MFA Rules not processed for user `c0735259f6184655a86c42a0e3928e53`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:20.516776 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1ccfe122-d7fd-4c8f-91a0-a744501f4e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:20.588342 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1326/2634] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:20.600652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55205b6b-4724-4345-96ad-1746a36c4789 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:20.657920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55205b6b-4724-4345-96ad-1746a36c4789 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:20.661665 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00ba49-c214-494f-9566-7ad4be47866d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:20.662465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ba49-c214-494f-9566-7ad4be47866d service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:20.662750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ba49-c214-494f-9566-7ad4be47866d service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:20.663029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ba49-c214-494f-9566-7ad4be47866d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:20.673477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00ba49-c214-494f-9566-7ad4be47866d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:20.674918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00ba49-c214-494f-9566-7ad4be47866d service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:20.685774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1309/2635] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:20.974483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe122-d7fd-4c8f-91a0-a744501f4e7f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:20.985619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfe122-d7fd-4c8f-91a0-a744501f4e7f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:20.992370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77cc25-189b-47ea-99b0-ffb1dcb1b532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:20.992370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77cc25-189b-47ea-99b0-ffb1dcb1b532 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:20.992370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77cc25-189b-47ea-99b0-ffb1dcb1b532 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:20.992370 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77cc25-189b-47ea-99b0-ffb1dcb1b532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:21.059209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77cc25-189b-47ea-99b0-ffb1dcb1b532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:21.060658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77cc25-189b-47ea-99b0-ffb1dcb1b532 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:21.070133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1327/2636] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:23.770942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7644b7e-5cfb-4186-aa21-5aa4029fdf31 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:23.771400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7644b7e-5cfb-4186-aa21-5aa4029fdf31 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:23.771603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7644b7e-5cfb-4186-aa21-5aa4029fdf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:23.791622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e7644b7e-5cfb-4186-aa21-5aa4029fdf31 None None] MFA Rules not processed for user `a41697666e4d41b8a362d18e539facd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:23.792816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e7644b7e-5cfb-4186-aa21-5aa4029fdf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:23.848367 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1310/2637] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:25.733424 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77cc25-189b-47ea-99b0-ffb1dcb1b532 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:25.796246 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77cc25-189b-47ea-99b0-ffb1dcb1b532 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:25.800701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:25.801607 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:25.801888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:25.802160 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] PATH_INFO: `/v3/users/354d717d2ed745a19765659b3b342175` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:25.803337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=354d717d2ed745a19765659b3b342175)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:25.806015 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:26.059767 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354d717d2ed745a19765659b3b342175'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:26.071987 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354d717d2ed745a19765659b3b342175'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:26.072771 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354d717d2ed745a19765659b3b342175'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:26.073438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354d717d2ed745a19765659b3b342175'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:26.189834 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354d717d2ed745a19765659b3b342175'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:26.203553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1328/2638] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:25 2022] DELETE /identity/v3/users/354d717d2ed745a19765659b3b342175 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:26.208242 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94786a-d480-4184-9e60-de0fa78c0550 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:26.208726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94786a-d480-4184-9e60-de0fa78c0550 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:26.208846 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94786a-d480-4184-9e60-de0fa78c0550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:26.228835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-4f94786a-d480-4184-9e60-de0fa78c0550 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:26.230096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4f94786a-d480-4184-9e60-de0fa78c0550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:26.293474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1311/2639] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:26.303257 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:26.304709 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:26.364614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe029-41f5-4f60-9802-6edd446b0821 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:26.370147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473b24f-282d-496f-b860-7c032ddb092e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:26.376526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473b24f-282d-496f-b860-7c032ddb092e service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:26.376526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473b24f-282d-496f-b860-7c032ddb092e service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:26.376526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473b24f-282d-496f-b860-7c032ddb092e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:26.382102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473b24f-282d-496f-b860-7c032ddb092e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:26.385784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473b24f-282d-496f-b860-7c032ddb092e service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:26.396206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1329/2640] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:26.876579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94786a-d480-4184-9e60-de0fa78c0550 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:26.878103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4f94786a-d480-4184-9e60-de0fa78c0550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:26.892716 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94786a-d480-4184-9e60-de0fa78c0550 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:26.897534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:26.898350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:26.898718 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:26.899142 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] PATH_INFO: `/v3/projects/006034bfa58f4f78902cf0083eb91536` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:26.900591 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=006034bfa58f4f78902cf0083eb91536)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:26.902711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:27.033175 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006034bfa58f4f78902cf0083eb91536', 'request_id': 'req-f2c61403-1849-4456-8fd9-68163097d8c1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.119779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006034bfa58f4f78902cf0083eb91536', 'request_id': 'req-f2c61403-1849-4456-8fd9-68163097d8c1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.126058 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006034bfa58f4f78902cf0083eb91536', 'request_id': 'req-f2c61403-1849-4456-8fd9-68163097d8c1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.138044 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] The token cache is being invalidate because project 006034bfa58f4f78902cf0083eb91536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:27.138339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.138999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.140526 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1312/2641] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:26 2022] DELETE /identity/v3/projects/006034bfa58f4f78902cf0083eb91536 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:27.144498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473b24f-282d-496f-b860-7c032ddb092e service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:27.154190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473b24f-282d-496f-b860-7c032ddb092e service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:27.209650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:27.210526 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:27.210810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:27.211122 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] PATH_INFO: `/v3/users/c0735259f6184655a86c42a0e3928e53` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:27.212380 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0735259f6184655a86c42a0e3928e53)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:27.214410 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:27.364072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0735259f6184655a86c42a0e3928e53'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.376064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0735259f6184655a86c42a0e3928e53'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.376746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0735259f6184655a86c42a0e3928e53'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.377473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0735259f6184655a86c42a0e3928e53'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.469785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0735259f6184655a86c42a0e3928e53'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:27.483076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1330/2642] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:27 2022] DELETE /identity/v3/users/c0735259f6184655a86c42a0e3928e53 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:27.609951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:27.611396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:27.670006 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61403-1849-4456-8fd9-68163097d8c1 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:27.719983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e44b7-3ccc-461c-b72c-2ea00d304cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:27.720573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e44b7-3ccc-461c-b72c-2ea00d304cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:27.720862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e44b7-3ccc-461c-b72c-2ea00d304cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:27.721140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e44b7-3ccc-461c-b72c-2ea00d304cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:27.722970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-384e44b7-3ccc-461c-b72c-2ea00d304cb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:27.791547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e44b7-3ccc-461c-b72c-2ea00d304cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:27.793315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e44b7-3ccc-461c-b72c-2ea00d304cb0 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:27.815849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1313/2643] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:27.900396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:27.901914 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:27.967504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c0b3b-3cf0-4fd1-867c-b98bdecde673 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:27.972288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:27.973083 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:27.973396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:27.973666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] PATH_INFO: `/v3/projects/d862c5f46f864f9c823279a0db5966d2` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:27.974841 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d862c5f46f864f9c823279a0db5966d2)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:27.976839 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:28.120868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd862c5f46f864f9c823279a0db5966d2', 'request_id': 'req-21927ad8-0be3-4a75-b460-938edff7d4d1'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:28.268445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd862c5f46f864f9c823279a0db5966d2', 'request_id': 'req-21927ad8-0be3-4a75-b460-938edff7d4d1'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:28.274481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd862c5f46f864f9c823279a0db5966d2', 'request_id': 'req-21927ad8-0be3-4a75-b460-938edff7d4d1'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:28.285603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] The token cache is being invalidate because project d862c5f46f864f9c823279a0db5966d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:28.285897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:28.286537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-21927ad8-0be3-4a75-b460-938edff7d4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:28.288103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1331/2644] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:27 2022] DELETE /identity/v3/projects/d862c5f46f864f9c823279a0db5966d2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:28.293703 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb389c-056c-4cb1-9ba6-856964092e04 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.294042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb389c-056c-4cb1-9ba6-856964092e04 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.300094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb389c-056c-4cb1-9ba6-856964092e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:28.312786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-efdb389c-056c-4cb1-9ba6-856964092e04 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:28.314023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-efdb389c-056c-4cb1-9ba6-856964092e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:28.378134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1314/2645] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:28.386842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cfd32-b0c0-4411-b8ba-452fbd22df06 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.387052 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cfd32-b0c0-4411-b8ba-452fbd22df06 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.387539 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cfd32-b0c0-4411-b8ba-452fbd22df06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:28.406237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-eb8cfd32-b0c0-4411-b8ba-452fbd22df06 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:28.407423 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-eb8cfd32-b0c0-4411-b8ba-452fbd22df06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:28.415402 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1332/2646] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:28.419711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb389c-056c-4cb1-9ba6-856964092e04 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:28.429658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb389c-056c-4cb1-9ba6-856964092e04 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:28.435988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:28.435988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.435988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.436318 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:28.436768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:28.437077 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:28.438709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:28.451097 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1315/2647] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:12:28.455777 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cfd32-b0c0-4411-b8ba-452fbd22df06 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:28.465637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cfd32-b0c0-4411-b8ba-452fbd22df06 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:28.470353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646d60f-baf2-4de0-a23d-0f240c2f1cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:28.470999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646d60f-baf2-4de0-a23d-0f240c2f1cca admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.471282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646d60f-baf2-4de0-a23d-0f240c2f1cca admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.471559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646d60f-baf2-4de0-a23d-0f240c2f1cca admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:28.472238 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646d60f-baf2-4de0-a23d-0f240c2f1cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:28.474154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646d60f-baf2-4de0-a23d-0f240c2f1cca admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:28.563223 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1333/2648] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:28 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:28.567462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:28.577638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad29b7-6207-476f-a2f9-0ec436047f6e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:28.638024 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5194-d399-4035-9ab1-967397413738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:28.638780 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5194-d399-4035-9ab1-967397413738 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.638977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5194-d399-4035-9ab1-967397413738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.639259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5194-d399-4035-9ab1-967397413738 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:28.639948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee5194-d399-4035-9ab1-967397413738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:28.641952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee5194-d399-4035-9ab1-967397413738 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:28.771913 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1316/2649] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:28 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:28.777363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646d60f-baf2-4de0-a23d-0f240c2f1cca admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:28.787496 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646d60f-baf2-4de0-a23d-0f240c2f1cca admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:28.792685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451122a4-9445-4ed5-8857-6ceefbeb94b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:28.793371 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451122a4-9445-4ed5-8857-6ceefbeb94b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.795108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451122a4-9445-4ed5-8857-6ceefbeb94b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.795108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451122a4-9445-4ed5-8857-6ceefbeb94b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:28.795108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451122a4-9445-4ed5-8857-6ceefbeb94b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:28.796211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451122a4-9445-4ed5-8857-6ceefbeb94b2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:28.806999 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1334/2650] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:28.810997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5194-d399-4035-9ab1-967397413738 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:28.821755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5194-d399-4035-9ab1-967397413738 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:28.826432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991d422-3750-49eb-9731-255e28b971c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:28.827084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991d422-3750-49eb-9731-255e28b971c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.827369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991d422-3750-49eb-9731-255e28b971c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.827747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991d422-3750-49eb-9731-255e28b971c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:28.828414 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991d422-3750-49eb-9731-255e28b971c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:28.830129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991d422-3750-49eb-9731-255e28b971c3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:28.840794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1317/2651] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:28.844907 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451122a4-9445-4ed5-8857-6ceefbeb94b2 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:28.854818 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451122a4-9445-4ed5-8857-6ceefbeb94b2 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:28.859467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156c834-171a-4b84-b2c8-213a6009c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:28.860339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156c834-171a-4b84-b2c8-213a6009c2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.860618 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156c834-171a-4b84-b2c8-213a6009c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.860892 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156c834-171a-4b84-b2c8-213a6009c2ff admin admin] PATH_INFO: `/v3/projects/bb99799dd58d47babe640365c2c4a6cc/users/bda46690c6164fe6ab2a5293031beb43/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:28.877659 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156c834-171a-4b84-b2c8-213a6009c2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb99799dd58d47babe640365c2c4a6cc, user_id=bda46690c6164fe6ab2a5293031beb43, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:28.880315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156c834-171a-4b84-b2c8-213a6009c2ff admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:28.978450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1335/2652] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:28 2022] PUT /identity/v3/projects/bb99799dd58d47babe640365c2c4a6cc/users/bda46690c6164fe6ab2a5293031beb43/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:28.989910 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009966-69ed-4d7f-9c9a-b7aa319f3729 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:28.990199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009966-69ed-4d7f-9c9a-b7aa319f3729 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:28.990476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009966-69ed-4d7f-9c9a-b7aa319f3729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.020420 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a4009966-69ed-4d7f-9c9a-b7aa319f3729 None None] MFA Rules not processed for user `bda46690c6164fe6ab2a5293031beb43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:29.021701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a4009966-69ed-4d7f-9c9a-b7aa319f3729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:29.088356 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1318/2653] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:29.092778 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156c834-171a-4b84-b2c8-213a6009c2ff admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:29.154253 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156c834-171a-4b84-b2c8-213a6009c2ff admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:29.160355 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e163f-3c7d-410e-92c2-58e882fe6869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:29.161031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e163f-3c7d-410e-92c2-58e882fe6869 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:29.161398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e163f-3c7d-410e-92c2-58e882fe6869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:29.161676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e163f-3c7d-410e-92c2-58e882fe6869 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.162547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e163f-3c7d-410e-92c2-58e882fe6869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:29.164695 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e163f-3c7d-410e-92c2-58e882fe6869 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:29.312486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1336/2654] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:29 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:29.316540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4009966-69ed-4d7f-9c9a-b7aa319f3729 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:29.328147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4009966-69ed-4d7f-9c9a-b7aa319f3729 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:29.384369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a1b2b-eb1d-4a5d-bec4-e6e67c5b6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:29.385043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a1b2b-eb1d-4a5d-bec4-e6e67c5b6106 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:29.385361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a1b2b-eb1d-4a5d-bec4-e6e67c5b6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:29.385643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a1b2b-eb1d-4a5d-bec4-e6e67c5b6106 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.386344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a1b2b-eb1d-4a5d-bec4-e6e67c5b6106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:29.388301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a1b2b-eb1d-4a5d-bec4-e6e67c5b6106 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:29.487152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1319/2655] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:29 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:29.491166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e163f-3c7d-410e-92c2-58e882fe6869 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:29.507485 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e163f-3c7d-410e-92c2-58e882fe6869 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:29.515140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9599c4-5798-4222-b202-ce68bd116f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:29.515808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9599c4-5798-4222-b202-ce68bd116f53 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:29.516095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9599c4-5798-4222-b202-ce68bd116f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:29.516373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9599c4-5798-4222-b202-ce68bd116f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.517107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9599c4-5798-4222-b202-ce68bd116f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:29.518759 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9599c4-5798-4222-b202-ce68bd116f53 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:29.529563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1337/2656] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:29.533857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a1b2b-eb1d-4a5d-bec4-e6e67c5b6106 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:29.544658 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a1b2b-eb1d-4a5d-bec4-e6e67c5b6106 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:29.549402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dee1c-26af-4bfb-9062-2b54493df2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:29.550284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dee1c-26af-4bfb-9062-2b54493df2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:29.550568 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dee1c-26af-4bfb-9062-2b54493df2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:29.550844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dee1c-26af-4bfb-9062-2b54493df2a5 admin admin] PATH_INFO: `/v3/projects/b3ebcd8be1df44839db61dcacfdb5d68/users/1a538d398ea3421587aa7dda438383c2/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.566191 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68dee1c-26af-4bfb-9062-2b54493df2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ebcd8be1df44839db61dcacfdb5d68, user_id=1a538d398ea3421587aa7dda438383c2, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:29.568858 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68dee1c-26af-4bfb-9062-2b54493df2a5 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:29.658989 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1320/2657] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:29 2022] PUT /identity/v3/projects/b3ebcd8be1df44839db61dcacfdb5d68/users/1a538d398ea3421587aa7dda438383c2/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:29.663138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9599c4-5798-4222-b202-ce68bd116f53 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:29.673962 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9599c4-5798-4222-b202-ce68bd116f53 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:29.729937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054b43c-c3d7-4812-a3f8-0ee6095e8d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:29.730624 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054b43c-c3d7-4812-a3f8-0ee6095e8d7c admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:29.730910 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054b43c-c3d7-4812-a3f8-0ee6095e8d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:29.731186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054b43c-c3d7-4812-a3f8-0ee6095e8d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.731928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054b43c-c3d7-4812-a3f8-0ee6095e8d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:29.733557 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054b43c-c3d7-4812-a3f8-0ee6095e8d7c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:29.744654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1338/2658] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:29.748705 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dee1c-26af-4bfb-9062-2b54493df2a5 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:29.759516 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dee1c-26af-4bfb-9062-2b54493df2a5 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:29.764237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:29.765147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:29.765463 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:29.765743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] PATH_INFO: `/v3/projects/b3ebcd8be1df44839db61dcacfdb5d68/users/1a538d398ea3421587aa7dda438383c2/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.767719 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ebcd8be1df44839db61dcacfdb5d68, user_id=1a538d398ea3421587aa7dda438383c2, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:29.770515 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:29.782087 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1321/2659] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:29 2022] PUT /identity/v3/projects/b3ebcd8be1df44839db61dcacfdb5d68/users/1a538d398ea3421587aa7dda438383c2/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:29.792994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857765b-19d0-455c-991f-8a0ce7f7e905 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:29.795635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857765b-19d0-455c-991f-8a0ce7f7e905 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:29.795635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857765b-19d0-455c-991f-8a0ce7f7e905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.819860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-3857765b-19d0-455c-991f-8a0ce7f7e905 None None] MFA Rules not processed for user `1a538d398ea3421587aa7dda438383c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:29.821301 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-3857765b-19d0-455c-991f-8a0ce7f7e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:29.891840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1339/2660] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:29.903124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:29.904839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:29.960829 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea41b2-19dc-49b2-b8e5-413dc917ba9d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:29.968242 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd4821-2b46-40d7-bfd3-d940b9e3c3ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:29.968850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd4821-2b46-40d7-bfd3-d940b9e3c3ca service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:29.969139 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd4821-2b46-40d7-bfd3-d940b9e3c3ca service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:29.969450 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd4821-2b46-40d7-bfd3-d940b9e3c3ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:29.979872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd4821-2b46-40d7-bfd3-d940b9e3c3ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:29.981368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd4821-2b46-40d7-bfd3-d940b9e3c3ca service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:29.991145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1322/2661] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:30.090948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857765b-19d0-455c-991f-8a0ce7f7e905 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:30.100586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857765b-19d0-455c-991f-8a0ce7f7e905 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:30.105399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad2180-5d02-438a-ae7f-55a208d7e077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:30.106076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2180-5d02-438a-ae7f-55a208d7e077 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:30.106365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2180-5d02-438a-ae7f-55a208d7e077 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:30.106645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2180-5d02-438a-ae7f-55a208d7e077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:30.169739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad2180-5d02-438a-ae7f-55a208d7e077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:30.169739 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad2180-5d02-438a-ae7f-55a208d7e077 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:30.174462 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1340/2662] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:34.394362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd4821-2b46-40d7-bfd3-d940b9e3c3ca service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:34.495344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd4821-2b46-40d7-bfd3-d940b9e3c3ca service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:34.501537 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:34.502438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:34.502823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:34.503281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] PATH_INFO: `/v3/users/bda46690c6164fe6ab2a5293031beb43` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:34.504466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda46690c6164fe6ab2a5293031beb43)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:34.506979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:34.764052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda46690c6164fe6ab2a5293031beb43'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:34.776306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda46690c6164fe6ab2a5293031beb43'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:34.777032 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda46690c6164fe6ab2a5293031beb43'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:34.777657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda46690c6164fe6ab2a5293031beb43'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:34.841184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda46690c6164fe6ab2a5293031beb43'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:34.856064 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1323/2663] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:34 2022] DELETE /identity/v3/users/bda46690c6164fe6ab2a5293031beb43 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:34.860646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc209b-fc38-4989-89de-5071be30da80 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:34.861165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc209b-fc38-4989-89de-5071be30da80 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:34.861284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc209b-fc38-4989-89de-5071be30da80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:34.880228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-dadc209b-fc38-4989-89de-5071be30da80 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:34.881486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-dadc209b-fc38-4989-89de-5071be30da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:34.946024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1341/2664] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:34.955626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:34.957344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:35.014973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d69b3-544d-469c-bc08-64de2e0e20b3 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:35.018585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c81414-ee26-43c5-9e46-dbec49c757f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:35.019226 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c81414-ee26-43c5-9e46-dbec49c757f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:35.019509 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c81414-ee26-43c5-9e46-dbec49c757f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:35.019784 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c81414-ee26-43c5-9e46-dbec49c757f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:35.031148 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c81414-ee26-43c5-9e46-dbec49c757f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:35.032694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c81414-ee26-43c5-9e46-dbec49c757f4 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:35.043350 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1324/2665] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:35.511614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc209b-fc38-4989-89de-5071be30da80 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:35.513119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-dadc209b-fc38-4989-89de-5071be30da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:35.526167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc209b-fc38-4989-89de-5071be30da80 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:35.530846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:35.531719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:35.532000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:35.532274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] PATH_INFO: `/v3/projects/bb99799dd58d47babe640365c2c4a6cc` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:35.534245 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb99799dd58d47babe640365c2c4a6cc)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:35.536164 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:35.654282 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb99799dd58d47babe640365c2c4a6cc', 'request_id': 'req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:35.725128 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb99799dd58d47babe640365c2c4a6cc', 'request_id': 'req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:35.732249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb99799dd58d47babe640365c2c4a6cc', 'request_id': 'req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:35.745030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] The token cache is being invalidate because project bb99799dd58d47babe640365c2c4a6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:35.745577 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:35.746362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:35.748219 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1342/2666] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:35 2022] DELETE /identity/v3/projects/bb99799dd58d47babe640365c2c4a6cc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:35.752155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c81414-ee26-43c5-9e46-dbec49c757f4 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:35.767312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c81414-ee26-43c5-9e46-dbec49c757f4 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:35.829551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:35.830432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:35.830713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:35.830993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] PATH_INFO: `/v3/users/1a538d398ea3421587aa7dda438383c2` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:35.832229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a538d398ea3421587aa7dda438383c2)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:35.834197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:36.043659 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a538d398ea3421587aa7dda438383c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.056045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a538d398ea3421587aa7dda438383c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.056839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a538d398ea3421587aa7dda438383c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.057480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a538d398ea3421587aa7dda438383c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.113909 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4445ec0c-f0ed-4e90-96b6-2a3da41a7b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a538d398ea3421587aa7dda438383c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.126957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1325/2667] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:35 2022] DELETE /identity/v3/users/1a538d398ea3421587aa7dda438383c2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:36.499744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:36.504712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:36.517536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c33aad-b6ee-48b4-b8af-566bf30c42e9 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:36.579735 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:36.580598 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:36.580882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:36.581161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] PATH_INFO: `/v3/projects/b3ebcd8be1df44839db61dcacfdb5d68` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:36.582396 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ebcd8be1df44839db61dcacfdb5d68)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:36.584329 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:36.687895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ebcd8be1df44839db61dcacfdb5d68', 'request_id': 'req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.761072 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ebcd8be1df44839db61dcacfdb5d68', 'request_id': 'req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.766890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ebcd8be1df44839db61dcacfdb5d68', 'request_id': 'req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.779980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] The token cache is being invalidate because project b3ebcd8be1df44839db61dcacfdb5d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:36.780278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.783332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3cfce027-ef3d-4313-8fa7-92fbd76b7a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:36.783332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1343/2668] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:36 2022] DELETE /identity/v3/projects/b3ebcd8be1df44839db61dcacfdb5d68 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:36.787490 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482543-e859-43f9-9b75-a7248761840b None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:36.787983 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482543-e859-43f9-9b75-a7248761840b None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:36.788084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482543-e859-43f9-9b75-a7248761840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:36.806183 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b9482543-e859-43f9-9b75-a7248761840b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:36.807381 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b9482543-e859-43f9-9b75-a7248761840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:36.871209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1326/2669] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:36.880067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344925-a69a-42d8-b3a6-c36e43e4b1ea None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:36.880373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344925-a69a-42d8-b3a6-c36e43e4b1ea None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:36.880632 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344925-a69a-42d8-b3a6-c36e43e4b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:36.900359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-51344925-a69a-42d8-b3a6-c36e43e4b1ea None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:36.901595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-51344925-a69a-42d8-b3a6-c36e43e4b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:36.909637 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1344/2670] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:36.913775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482543-e859-43f9-9b75-a7248761840b None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:36.924588 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482543-e859-43f9-9b75-a7248761840b None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:36.929464 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:36.930700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:36.930987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:36.931260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:36.931993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:36.932364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:36.933935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:36.946425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1327/2671] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:12:36.950821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344925-a69a-42d8-b3a6-c36e43e4b1ea None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:36.959925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344925-a69a-42d8-b3a6-c36e43e4b1ea None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:36.964785 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc21d-0de1-4fd8-b8d9-328d20568fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:36.965475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc21d-0de1-4fd8-b8d9-328d20568fcc admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:36.965772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc21d-0de1-4fd8-b8d9-328d20568fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:36.966031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc21d-0de1-4fd8-b8d9-328d20568fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:36.966716 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fc21d-0de1-4fd8-b8d9-328d20568fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:36.968605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fc21d-0de1-4fd8-b8d9-328d20568fcc admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.082584 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1345/2672] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:36 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:37.089862 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.099865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edf812-26ab-4ccc-ac3e-21f676cc8f37 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.157854 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952d41c-ce65-4c9c-973d-fed91be55a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.158581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d41c-ce65-4c9c-973d-fed91be55a8e admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.159096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d41c-ce65-4c9c-973d-fed91be55a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.159409 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d41c-ce65-4c9c-973d-fed91be55a8e admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.160217 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952d41c-ce65-4c9c-973d-fed91be55a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.162186 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952d41c-ce65-4c9c-973d-fed91be55a8e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.281883 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1328/2673] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:37 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:37.285889 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc21d-0de1-4fd8-b8d9-328d20568fcc admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.297110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc21d-0de1-4fd8-b8d9-328d20568fcc admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.301996 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fa38b-54ff-474a-b172-b46c1de57338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.302667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa38b-54ff-474a-b172-b46c1de57338 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.302958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa38b-54ff-474a-b172-b46c1de57338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.303239 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fa38b-54ff-474a-b172-b46c1de57338 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.303979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fa38b-54ff-474a-b172-b46c1de57338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.305727 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fa38b-54ff-474a-b172-b46c1de57338 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.317057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1346/2674] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:37.320842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952d41c-ce65-4c9c-973d-fed91be55a8e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.331446 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952d41c-ce65-4c9c-973d-fed91be55a8e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.336852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fc1e7-4373-466b-a27b-ad9abe6d17ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.337549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc1e7-4373-466b-a27b-ad9abe6d17ff admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.337834 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc1e7-4373-466b-a27b-ad9abe6d17ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.338113 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc1e7-4373-466b-a27b-ad9abe6d17ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.338851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fc1e7-4373-466b-a27b-ad9abe6d17ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.340458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fc1e7-4373-466b-a27b-ad9abe6d17ff admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.355275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1329/2675] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:37.358847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fa38b-54ff-474a-b172-b46c1de57338 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.366606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fa38b-54ff-474a-b172-b46c1de57338 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.371667 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1066529-0ada-4e54-8924-ecc90f4bbc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.372552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066529-0ada-4e54-8924-ecc90f4bbc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.372847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066529-0ada-4e54-8924-ecc90f4bbc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.373124 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066529-0ada-4e54-8924-ecc90f4bbc02 admin admin] PATH_INFO: `/v3/projects/30863efeca3643ad991f6973630d8b1f/users/e37c205677a1434a9615e53102f7cba1/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.388471 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1066529-0ada-4e54-8924-ecc90f4bbc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30863efeca3643ad991f6973630d8b1f, user_id=e37c205677a1434a9615e53102f7cba1, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.391155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1066529-0ada-4e54-8924-ecc90f4bbc02 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.458095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1347/2676] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:37 2022] PUT /identity/v3/projects/30863efeca3643ad991f6973630d8b1f/users/e37c205677a1434a9615e53102f7cba1/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:37.468970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01948496-da7b-4151-8c14-fdc839a65821 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.469286 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01948496-da7b-4151-8c14-fdc839a65821 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.469571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01948496-da7b-4151-8c14-fdc839a65821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.497790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-01948496-da7b-4151-8c14-fdc839a65821 None None] MFA Rules not processed for user `e37c205677a1434a9615e53102f7cba1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:37.499104 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-01948496-da7b-4151-8c14-fdc839a65821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:37.563945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1330/2677] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:37.568452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1066529-0ada-4e54-8924-ecc90f4bbc02 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.629206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1066529-0ada-4e54-8924-ecc90f4bbc02 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.634673 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81ebda-cc63-465c-9538-a12c024e1565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.635320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81ebda-cc63-465c-9538-a12c024e1565 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.635992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81ebda-cc63-465c-9538-a12c024e1565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.635992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81ebda-cc63-465c-9538-a12c024e1565 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.637398 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81ebda-cc63-465c-9538-a12c024e1565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.638498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81ebda-cc63-465c-9538-a12c024e1565 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.734043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1348/2678] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:37 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:37.738090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01948496-da7b-4151-8c14-fdc839a65821 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.749560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01948496-da7b-4151-8c14-fdc839a65821 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.807081 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c16d-965e-4bfb-ad6e-3942a0f07c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.807791 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c16d-965e-4bfb-ad6e-3942a0f07c05 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.808100 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c16d-965e-4bfb-ad6e-3942a0f07c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.808297 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c16d-965e-4bfb-ad6e-3942a0f07c05 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.808971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87c16d-965e-4bfb-ad6e-3942a0f07c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.810915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87c16d-965e-4bfb-ad6e-3942a0f07c05 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.875547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1331/2679] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:37 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:37.879451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81ebda-cc63-465c-9538-a12c024e1565 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.890575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81ebda-cc63-465c-9538-a12c024e1565 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.895296 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510b530-6b77-48f9-a75f-fa6938d1e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.895957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510b530-6b77-48f9-a75f-fa6938d1e573 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.896269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510b530-6b77-48f9-a75f-fa6938d1e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.896555 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510b530-6b77-48f9-a75f-fa6938d1e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.897317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510b530-6b77-48f9-a75f-fa6938d1e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.899701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510b530-6b77-48f9-a75f-fa6938d1e573 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.910532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1349/2680] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:37.916067 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c16d-965e-4bfb-ad6e-3942a0f07c05 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.926604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c16d-965e-4bfb-ad6e-3942a0f07c05 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.931584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376a3dc-c1e0-40f8-ab13-55877d130ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.932245 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a3dc-c1e0-40f8-ab13-55877d130ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.932529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a3dc-c1e0-40f8-ab13-55877d130ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.932810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a3dc-c1e0-40f8-ab13-55877d130ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.933717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376a3dc-c1e0-40f8-ab13-55877d130ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.935344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376a3dc-c1e0-40f8-ab13-55877d130ba7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:37.948839 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1332/2681] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:37.953089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510b530-6b77-48f9-a75f-fa6938d1e573 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:37.963886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510b530-6b77-48f9-a75f-fa6938d1e573 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:37.968840 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3820c1-048a-4fe0-8e3b-805a74798320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:37.969765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3820c1-048a-4fe0-8e3b-805a74798320 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:37.970053 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3820c1-048a-4fe0-8e3b-805a74798320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:37.970335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3820c1-048a-4fe0-8e3b-805a74798320 admin admin] PATH_INFO: `/v3/projects/62a0a56d36c242c89a4995363e43e492/users/e7199d16c41d422eaaf0b20a4eedb0b9/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:37.986086 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3820c1-048a-4fe0-8e3b-805a74798320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a0a56d36c242c89a4995363e43e492, user_id=e7199d16c41d422eaaf0b20a4eedb0b9, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:37.988756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3820c1-048a-4fe0-8e3b-805a74798320 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:38.080744 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1350/2682] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:37 2022] PUT /identity/v3/projects/62a0a56d36c242c89a4995363e43e492/users/e7199d16c41d422eaaf0b20a4eedb0b9/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:38.092068 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc412c-4547-4882-9a6b-f0b4bc9c9d54 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:38.092307 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc412c-4547-4882-9a6b-f0b4bc9c9d54 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:38.092592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc412c-4547-4882-9a6b-f0b4bc9c9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:38.120477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-c1cc412c-4547-4882-9a6b-f0b4bc9c9d54 None None] MFA Rules not processed for user `e7199d16c41d422eaaf0b20a4eedb0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:38.121712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c1cc412c-4547-4882-9a6b-f0b4bc9c9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:38.187958 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1333/2683] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:38.192365 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3820c1-048a-4fe0-8e3b-805a74798320 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:38.264227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3820c1-048a-4fe0-8e3b-805a74798320 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:38.269487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508662d7-c0cd-4875-8148-380b570db971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:38.270154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508662d7-c0cd-4875-8148-380b570db971 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:38.270440 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508662d7-c0cd-4875-8148-380b570db971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:38.274108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508662d7-c0cd-4875-8148-380b570db971 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:38.274108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508662d7-c0cd-4875-8148-380b570db971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:38.274108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508662d7-c0cd-4875-8148-380b570db971 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:38.449331 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1351/2684] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:38 2022] POST /identity/v3/projects => generated 375 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:38.453098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc412c-4547-4882-9a6b-f0b4bc9c9d54 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:38.467688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc412c-4547-4882-9a6b-f0b4bc9c9d54 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:38.525408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9da69a-d467-438b-b781-00ddd10acbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:38.526089 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9da69a-d467-438b-b781-00ddd10acbad admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:38.526533 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9da69a-d467-438b-b781-00ddd10acbad admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:38.526686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9da69a-d467-438b-b781-00ddd10acbad admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:38.527375 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9da69a-d467-438b-b781-00ddd10acbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:38.529224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9da69a-d467-438b-b781-00ddd10acbad admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:38.625293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1334/2685] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:38 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:38.630382 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508662d7-c0cd-4875-8148-380b570db971 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:38.643857 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508662d7-c0cd-4875-8148-380b570db971 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:38.649298 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de5fd3-5b28-4fca-a37f-b60c9c18d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:38.650041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de5fd3-5b28-4fca-a37f-b60c9c18d768 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:38.650320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de5fd3-5b28-4fca-a37f-b60c9c18d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:38.650594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de5fd3-5b28-4fca-a37f-b60c9c18d768 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:38.651325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de5fd3-5b28-4fca-a37f-b60c9c18d768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:38.652917 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de5fd3-5b28-4fca-a37f-b60c9c18d768 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:38.664499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1352/2686] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:38.677361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9da69a-d467-438b-b781-00ddd10acbad admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:38.688514 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9da69a-d467-438b-b781-00ddd10acbad admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:38.693209 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08297121-afa0-42c5-b2a4-c5604858752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:38.694118 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297121-afa0-42c5-b2a4-c5604858752f admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:38.694400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297121-afa0-42c5-b2a4-c5604858752f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:38.694672 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297121-afa0-42c5-b2a4-c5604858752f admin admin] PATH_INFO: `/v3/projects/312ddae6cec241fcbc815aa1ababce46/users/291bc5864743486b8f15b3674e8ace19/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:38.710534 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08297121-afa0-42c5-b2a4-c5604858752f admin admin] RBAC: Authorizing `identity:create_grant(project_id=312ddae6cec241fcbc815aa1ababce46, user_id=291bc5864743486b8f15b3674e8ace19, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:38.713904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08297121-afa0-42c5-b2a4-c5604858752f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:38.853711 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1335/2687] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:38 2022] PUT /identity/v3/projects/312ddae6cec241fcbc815aa1ababce46/users/291bc5864743486b8f15b3674e8ace19/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:38.857710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de5fd3-5b28-4fca-a37f-b60c9c18d768 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:38.868111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de5fd3-5b28-4fca-a37f-b60c9c18d768 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:38.924169 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e8faa-20e0-4c62-af79-9c0855b8895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:38.924835 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8faa-20e0-4c62-af79-9c0855b8895f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:38.925120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8faa-20e0-4c62-af79-9c0855b8895f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:38.925501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e8faa-20e0-4c62-af79-9c0855b8895f admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:38.926230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e8faa-20e0-4c62-af79-9c0855b8895f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:38.927814 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e8faa-20e0-4c62-af79-9c0855b8895f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:38.937594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1353/2688] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:38.941802 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08297121-afa0-42c5-b2a4-c5604858752f admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:38.952193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08297121-afa0-42c5-b2a4-c5604858752f admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:38.956877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:38.957789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:38.958072 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:38.958354 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] PATH_INFO: `/v3/projects/312ddae6cec241fcbc815aa1ababce46/users/291bc5864743486b8f15b3674e8ace19/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:38.960548 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=312ddae6cec241fcbc815aa1ababce46, user_id=291bc5864743486b8f15b3674e8ace19, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:38.963747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:38.974474 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1336/2689] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:38 2022] PUT /identity/v3/projects/312ddae6cec241fcbc815aa1ababce46/users/291bc5864743486b8f15b3674e8ace19/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:38.986387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5475a-2b6e-4ba0-817e-262e7b0e6232 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:38.986673 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5475a-2b6e-4ba0-817e-262e7b0e6232 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:38.986957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5475a-2b6e-4ba0-817e-262e7b0e6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:39.013553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-9ca5475a-2b6e-4ba0-817e-262e7b0e6232 None None] MFA Rules not processed for user `291bc5864743486b8f15b3674e8ace19`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:39.014745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9ca5475a-2b6e-4ba0-817e-262e7b0e6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:39.085031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1354/2690] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:39.097611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:39.099352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:39.157059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f4f8b-57f9-4500-8ffc-4747a41453ed admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:39.160873 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:39.161564 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:39.161853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:39.162129 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:39.218396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:39.219774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:39.228878 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1337/2691] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:40.742592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8219f2-f817-4243-a798-cbbf768b3aa8 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:40.743114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8219f2-f817-4243-a798-cbbf768b3aa8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:40.743315 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8219f2-f817-4243-a798-cbbf768b3aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:40.767010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-5e8219f2-f817-4243-a798-cbbf768b3aa8 None None] MFA Rules not processed for user `4290947cee5b49dda7f75d4656d4e834`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:40.768324 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5e8219f2-f817-4243-a798-cbbf768b3aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:40.840395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1355/2692] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:41.637476 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:41.638892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:41.651326 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7509cae-18a7-484a-ad13-93d94b97cd8a service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:41.656575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:41.656575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:41.656575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:41.656575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:41.718034 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:41.719481 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:41.729813 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1338/2693] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:44.499769 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8219f2-f817-4243-a798-cbbf768b3aa8 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:44.510068 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8219f2-f817-4243-a798-cbbf768b3aa8 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:44.513679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c2605-856b-474c-942a-f2c2da1d6a29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:44.518665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c2605-856b-474c-942a-f2c2da1d6a29 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:44.518665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c2605-856b-474c-942a-f2c2da1d6a29 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:44.518665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c2605-856b-474c-942a-f2c2da1d6a29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:44.525428 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c2605-856b-474c-942a-f2c2da1d6a29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:44.527314 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c2605-856b-474c-942a-f2c2da1d6a29 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:44.537312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1356/2694] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:49.900428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:49.901912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:49.968713 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069edfcd-46b4-4aa0-9d0c-89cbdcea002a service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:49.973302 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:49.974170 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:49.974454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:49.974801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] PATH_INFO: `/v3/users/998c34eba26040188396e7b76d68f4f7` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:49.976005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=998c34eba26040188396e7b76d68f4f7)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:49.978945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:50.000810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c2605-856b-474c-942a-f2c2da1d6a29 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:50.011242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c2605-856b-474c-942a-f2c2da1d6a29 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:50.016059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:50.024444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:50.024444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:50.024444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] PATH_INFO: `/v3/users/e37c205677a1434a9615e53102f7cba1` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:50.024444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37c205677a1434a9615e53102f7cba1)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:50.024444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:50.203991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998c34eba26040188396e7b76d68f4f7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.224042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998c34eba26040188396e7b76d68f4f7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.224042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998c34eba26040188396e7b76d68f4f7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.224042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998c34eba26040188396e7b76d68f4f7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.227560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37c205677a1434a9615e53102f7cba1'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.239112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37c205677a1434a9615e53102f7cba1'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.239792 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37c205677a1434a9615e53102f7cba1'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.240393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37c205677a1434a9615e53102f7cba1'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.303919 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-82b75739-28fe-4315-8c53-94d51683c39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998c34eba26040188396e7b76d68f4f7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.318166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1339/2695] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:49 2022] DELETE /identity/v3/users/998c34eba26040188396e7b76d68f4f7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:50.323454 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0be2-b850-4bfb-82c9-39b0726105a3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:50.323768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0be2-b850-4bfb-82c9-39b0726105a3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:50.324051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0be2-b850-4bfb-82c9-39b0726105a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:50.340796 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-7c7a0be2-b850-4bfb-82c9-39b0726105a3 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:50.342017 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7c7a0be2-b850-4bfb-82c9-39b0726105a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:50.349211 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-41c0a294-6583-4042-9aa0-938cddc04010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37c205677a1434a9615e53102f7cba1'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:50.362884 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1357/2696] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:49 2022] DELETE /identity/v3/users/e37c205677a1434a9615e53102f7cba1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:50.367535 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fad76-43fe-4435-bc18-07a7456c1827 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:50.367849 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fad76-43fe-4435-bc18-07a7456c1827 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:50.368140 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fad76-43fe-4435-bc18-07a7456c1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:50.386629 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-769fad76-43fe-4435-bc18-07a7456c1827 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:50.387962 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-769fad76-43fe-4435-bc18-07a7456c1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:50.402237 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1340/2697] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:50.411966 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a0be2-b850-4bfb-82c9-39b0726105a3 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:50.413337 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-7c7a0be2-b850-4bfb-82c9-39b0726105a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:50.446608 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1358/2698] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:50.456435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fad76-43fe-4435-bc18-07a7456c1827 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:50.457773 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-769fad76-43fe-4435-bc18-07a7456c1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:50.471616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a0be2-b850-4bfb-82c9-39b0726105a3 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:50.516448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fad76-43fe-4435-bc18-07a7456c1827 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:50.520196 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:50.520846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:50.521131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:50.521442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:50.525915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:50.526573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:50.527001 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:50.527283 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:50.531446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:50.532929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:50.536634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:50.538282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:50.542981 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1359/2699] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:50.548590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1341/2700] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:51.082258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:51.084249 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:51.100447 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b201d3-fb26-4110-a8cd-3ecea52f9192 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:51.107023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:51.108010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:51.108654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:51.109206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] PATH_INFO: `/v3/projects/30863efeca3643ad991f6973630d8b1f` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:51.111119 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30863efeca3643ad991f6973630d8b1f)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:51.114005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:51.250385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30863efeca3643ad991f6973630d8b1f', 'request_id': 'req-74b11499-1146-478d-9249-7b8bd49ec685'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.276900 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:51.278555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:51.294619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc7072-0fdd-41be-a201-9052d74cb7fe service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:51.338281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30863efeca3643ad991f6973630d8b1f', 'request_id': 'req-74b11499-1146-478d-9249-7b8bd49ec685'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.345076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30863efeca3643ad991f6973630d8b1f', 'request_id': 'req-74b11499-1146-478d-9249-7b8bd49ec685'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.358048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] The token cache is being invalidate because project 30863efeca3643ad991f6973630d8b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:51.358351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.359055 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.360719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1360/2701] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:51 2022] DELETE /identity/v3/projects/30863efeca3643ad991f6973630d8b1f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:51.362166 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:51.363361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:51.363709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:51.363993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] PATH_INFO: `/v3/projects/5271252f74454b4dbf5b781663ef7f78` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:51.365034 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:51.365293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5271252f74454b4dbf5b781663ef7f78)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:51.366483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:51.367988 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:51.381389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11499-1146-478d-9249-7b8bd49ec685 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:51.389310 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:51.390304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:51.390621 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:51.390901 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] PATH_INFO: `/v3/users/e7199d16c41d422eaaf0b20a4eedb0b9` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:51.392237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7199d16c41d422eaaf0b20a4eedb0b9)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:51.395391 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:51.494301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5271252f74454b4dbf5b781663ef7f78', 'request_id': 'req-d052d926-3115-443a-a8c5-a6183a793244'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.629126 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5271252f74454b4dbf5b781663ef7f78', 'request_id': 'req-d052d926-3115-443a-a8c5-a6183a793244'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.636346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5271252f74454b4dbf5b781663ef7f78', 'request_id': 'req-d052d926-3115-443a-a8c5-a6183a793244'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.647619 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] The token cache is being invalidate because project 5271252f74454b4dbf5b781663ef7f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:51.647907 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.648777 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.650432 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1342/2702] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:51 2022] DELETE /identity/v3/projects/5271252f74454b4dbf5b781663ef7f78 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:51.654746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:51.656912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:51.673341 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7199d16c41d422eaaf0b20a4eedb0b9'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.686047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7199d16c41d422eaaf0b20a4eedb0b9'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.686791 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7199d16c41d422eaaf0b20a4eedb0b9'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.687412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7199d16c41d422eaaf0b20a4eedb0b9'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.727609 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052d926-3115-443a-a8c5-a6183a793244 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:51.733461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:51.734632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:51.735009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:51.735352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] PATH_INFO: `/v3/users/4442e951e40e404894ed88db04b83231` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:51.736654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4442e951e40e404894ed88db04b83231)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:51.738965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:51.771991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7199d16c41d422eaaf0b20a4eedb0b9'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.786404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1361/2703] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:51 2022] DELETE /identity/v3/users/e7199d16c41d422eaaf0b20a4eedb0b9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:51.922400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4442e951e40e404894ed88db04b83231'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.935181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4442e951e40e404894ed88db04b83231'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.935906 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4442e951e40e404894ed88db04b83231'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.936517 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4442e951e40e404894ed88db04b83231'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:51.996305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4442e951e40e404894ed88db04b83231'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.011522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1343/2704] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:51 2022] DELETE /identity/v3/users/4442e951e40e404894ed88db04b83231 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:52.204640 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:52.205111 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:52.305964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56a98-5d4b-458d-8e0d-e4ab7179ab7e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:52.364175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:52.365051 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:52.365436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:52.377309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] PATH_INFO: `/v3/projects/62a0a56d36c242c89a4995363e43e492` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:52.377309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a0a56d36c242c89a4995363e43e492)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:52.377309 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:52.524452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a0a56d36c242c89a4995363e43e492', 'request_id': 'req-9dbdb087-3682-4065-a863-3b9ae5f29d91'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.640350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a0a56d36c242c89a4995363e43e492', 'request_id': 'req-9dbdb087-3682-4065-a863-3b9ae5f29d91'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.646824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a0a56d36c242c89a4995363e43e492', 'request_id': 'req-9dbdb087-3682-4065-a863-3b9ae5f29d91'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.658980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] The token cache is being invalidate because project 62a0a56d36c242c89a4995363e43e492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:52.659353 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.660089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.661936 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1362/2705] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:52 2022] DELETE /identity/v3/projects/62a0a56d36c242c89a4995363e43e492 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:52.666530 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:52.667971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:52.682602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e50ae-102a-4e8d-b976-6f86a0ca64a3 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:52.689897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:52.692227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:52.767890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:52.768774 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:52.769059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:52.769364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] PATH_INFO: `/v3/users/291bc5864743486b8f15b3674e8ace19` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:52.770575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=291bc5864743486b8f15b3674e8ace19)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:52.772502 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:52.774461 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdb087-3682-4065-a863-3b9ae5f29d91 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:52.779652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:52.780532 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:52.780821 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:52.781106 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] PATH_INFO: `/v3/projects/d1ff0cdba88740a0b7595b929dcd1b0e` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:52.784246 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ff0cdba88740a0b7595b929dcd1b0e)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:52.786228 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:52.953064 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ff0cdba88740a0b7595b929dcd1b0e', 'request_id': 'req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.953359 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291bc5864743486b8f15b3674e8ace19'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.965872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291bc5864743486b8f15b3674e8ace19'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.966447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291bc5864743486b8f15b3674e8ace19'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:52.967051 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291bc5864743486b8f15b3674e8ace19'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:53.046510 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ff0cdba88740a0b7595b929dcd1b0e', 'request_id': 'req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:53.052533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ff0cdba88740a0b7595b929dcd1b0e', 'request_id': 'req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:53.064286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] The token cache is being invalidate because project d1ff0cdba88740a0b7595b929dcd1b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:53.064576 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:53.065266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-82bfcdfe-5738-44ed-9e9a-52e72d8b93b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:53.067762 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1363/2706] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:52 2022] DELETE /identity/v3/projects/d1ff0cdba88740a0b7595b929dcd1b0e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:53.072853 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c7f6f-6337-4d1d-ada0-13f0c1c0ca7d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.073183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c7f6f-6337-4d1d-ada0-13f0c1c0ca7d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.073558 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c7f6f-6337-4d1d-ada0-13f0c1c0ca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.093756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-8e9c7f6f-6337-4d1d-ada0-13f0c1c0ca7d None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:53.095063 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8e9c7f6f-6337-4d1d-ada0-13f0c1c0ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:53.109222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-368cbc8b-cd8d-4321-a290-7d8f28f2e94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291bc5864743486b8f15b3674e8ace19'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:53.122455 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1344/2707] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:52 2022] DELETE /identity/v3/users/291bc5864743486b8f15b3674e8ace19 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:53.160023 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1364/2708] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:53.168643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f114d-a257-4a8f-942c-8885090af348 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.169133 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f114d-a257-4a8f-942c-8885090af348 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.169557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f114d-a257-4a8f-942c-8885090af348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.190433 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-671f114d-a257-4a8f-942c-8885090af348 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:53.191682 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-671f114d-a257-4a8f-942c-8885090af348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:53.256346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1345/2709] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:53.268242 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c7f6f-6337-4d1d-ada0-13f0c1c0ca7d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:53.277912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c7f6f-6337-4d1d-ada0-13f0c1c0ca7d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:53.283028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:53.283687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.283973 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.284244 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.285000 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:53.285345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:53.286959 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:53.298897 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1365/2710] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:12:53.303555 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f114d-a257-4a8f-942c-8885090af348 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:53.313794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f114d-a257-4a8f-942c-8885090af348 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:53.318439 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:53.319093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.319376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.319652 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.321221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:53.323153 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:53.439722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1346/2711] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:53 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:53.440895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:53.452231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769c0e-b532-4741-8656-20bae2a8634b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:53.509764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9c21-711a-4379-bf67-3ddc6ccca275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:53.510362 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9c21-711a-4379-bf67-3ddc6ccca275 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.510645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9c21-711a-4379-bf67-3ddc6ccca275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.510920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9c21-711a-4379-bf67-3ddc6ccca275 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.511625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9c21-711a-4379-bf67-3ddc6ccca275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:53.513605 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9c21-711a-4379-bf67-3ddc6ccca275 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:53.643765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:53.645743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:53.671877 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8407c8c-705b-4230-8964-287058a9c571 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:53.677423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:53.678940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.678940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.678940 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] PATH_INFO: `/v3/projects/312ddae6cec241fcbc815aa1ababce46` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.680501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312ddae6cec241fcbc815aa1ababce46)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:53.682200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1366/2712] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:53 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:53.683218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9c21-711a-4379-bf67-3ddc6ccca275 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:53.683369 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:53.694172 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9c21-711a-4379-bf67-3ddc6ccca275 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:53.699872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab3f76-0df7-4d15-b2c1-9c338927d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:53.700528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3f76-0df7-4d15-b2c1-9c338927d024 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.700884 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3f76-0df7-4d15-b2c1-9c338927d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.701230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3f76-0df7-4d15-b2c1-9c338927d024 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.702351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab3f76-0df7-4d15-b2c1-9c338927d024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:53.704181 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab3f76-0df7-4d15-b2c1-9c338927d024 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:53.716676 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1367/2713] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:53.721467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab3f76-0df7-4d15-b2c1-9c338927d024 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:53.731449 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab3f76-0df7-4d15-b2c1-9c338927d024 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:53.736213 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b4f2-d3d6-4e67-8964-d6a103699019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:53.744991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b4f2-d3d6-4e67-8964-d6a103699019 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.744991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b4f2-d3d6-4e67-8964-d6a103699019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.744991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b4f2-d3d6-4e67-8964-d6a103699019 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.744991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25b4f2-d3d6-4e67-8964-d6a103699019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:53.744991 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25b4f2-d3d6-4e67-8964-d6a103699019 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:53.751215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1368/2714] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:53.755553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b4f2-d3d6-4e67-8964-d6a103699019 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:53.766433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b4f2-d3d6-4e67-8964-d6a103699019 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:53.771161 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14347a-412c-4c6e-9581-9c0a029b3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:53.772048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14347a-412c-4c6e-9581-9c0a029b3025 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.772327 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14347a-412c-4c6e-9581-9c0a029b3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.772625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14347a-412c-4c6e-9581-9c0a029b3025 admin admin] PATH_INFO: `/v3/projects/9e6c6e98588e4e518f7fed7423539b30/users/120a601dc0d34269bc5b09009090507a/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.788377 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14347a-412c-4c6e-9581-9c0a029b3025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6c6e98588e4e518f7fed7423539b30, user_id=120a601dc0d34269bc5b09009090507a, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:53.791523 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14347a-412c-4c6e-9581-9c0a029b3025 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:53.934078 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1369/2715] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:53 2022] PUT /identity/v3/projects/9e6c6e98588e4e518f7fed7423539b30/users/120a601dc0d34269bc5b09009090507a/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:53.946316 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0687-c674-4914-9ce8-0c6c6ca34b52 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:53.947658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0687-c674-4914-9ce8-0c6c6ca34b52 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:53.947658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c0687-c674-4914-9ce8-0c6c6ca34b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:53.951657 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312ddae6cec241fcbc815aa1ababce46', 'request_id': 'req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:53.976654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-378c0687-c674-4914-9ce8-0c6c6ca34b52 None None] MFA Rules not processed for user `120a601dc0d34269bc5b09009090507a`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:53.977912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-378c0687-c674-4914-9ce8-0c6c6ca34b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:54.040753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312ddae6cec241fcbc815aa1ababce46', 'request_id': 'req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:54.049044 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1370/2716] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:54.049222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312ddae6cec241fcbc815aa1ababce46', 'request_id': 'req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:54.050812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c0687-c674-4914-9ce8-0c6c6ca34b52 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.059946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] The token cache is being invalidate because project 312ddae6cec241fcbc815aa1ababce46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:54.060242 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:54.060914 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-fd20ac1d-8d93-417b-9a1c-a4042b7e8540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:54.062740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1347/2717] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:53 2022] DELETE /identity/v3/projects/312ddae6cec241fcbc815aa1ababce46 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:54.069150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93785093-c019-4912-a30f-bdc299c61df4 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.069465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93785093-c019-4912-a30f-bdc299c61df4 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.069747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93785093-c019-4912-a30f-bdc299c61df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.093021 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-93785093-c019-4912-a30f-bdc299c61df4 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:54.095760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-93785093-c019-4912-a30f-bdc299c61df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:54.121872 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c0687-c674-4914-9ce8-0c6c6ca34b52 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.126755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.127442 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.127728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.128009 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.128710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.130664 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.158535 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1348/2718] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:54.167573 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91780efe-3442-4228-aa03-4ec5dc8e10b5 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.167865 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91780efe-3442-4228-aa03-4ec5dc8e10b5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.168141 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91780efe-3442-4228-aa03-4ec5dc8e10b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.187110 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-91780efe-3442-4228-aa03-4ec5dc8e10b5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:54.188273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-91780efe-3442-4228-aa03-4ec5dc8e10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:54.196376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1349/2719] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:54.200566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91780efe-3442-4228-aa03-4ec5dc8e10b5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.210212 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91780efe-3442-4228-aa03-4ec5dc8e10b5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.214542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.215189 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.215475 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.217675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.218428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:54.218745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.221218 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.239049 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1350/2720] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:12:54.246379 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.256039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79825554-7f77-4d36-9a6b-3df20b61f6fa admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.261084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29690c-4226-4e79-8532-36780e01461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.261789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29690c-4226-4e79-8532-36780e01461b admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.262071 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29690c-4226-4e79-8532-36780e01461b admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.262390 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29690c-4226-4e79-8532-36780e01461b admin admin] PATH_INFO: `/v3/projects` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.263043 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29690c-4226-4e79-8532-36780e01461b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.265006 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29690c-4226-4e79-8532-36780e01461b admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.271451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1371/2721] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:54.274800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.276528 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:54.339836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781acca-4c92-413d-90bf-793e3600fc6f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.344517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12042fd-34b5-472d-8971-e1f70cc58ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.345184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12042fd-34b5-472d-8971-e1f70cc58ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.345499 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12042fd-34b5-472d-8971-e1f70cc58ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.345780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12042fd-34b5-472d-8971-e1f70cc58ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.346469 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12042fd-34b5-472d-8971-e1f70cc58ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.348392 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12042fd-34b5-472d-8971-e1f70cc58ba6 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.362228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1351/2722] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:54.366501 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29690c-4226-4e79-8532-36780e01461b admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.427769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29690c-4226-4e79-8532-36780e01461b admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.433308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54582c5c-9f3c-4d38-8ed4-ed7879b5d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.433977 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582c5c-9f3c-4d38-8ed4-ed7879b5d306 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.434261 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582c5c-9f3c-4d38-8ed4-ed7879b5d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.434540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582c5c-9f3c-4d38-8ed4-ed7879b5d306 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.435223 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54582c5c-9f3c-4d38-8ed4-ed7879b5d306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.437140 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54582c5c-9f3c-4d38-8ed4-ed7879b5d306 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.458435 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1372/2723] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:54.462656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12042fd-34b5-472d-8971-e1f70cc58ba6 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.472265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12042fd-34b5-472d-8971-e1f70cc58ba6 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.477847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab799a-51ae-4b28-beb1-6b6ade34b7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.478589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab799a-51ae-4b28-beb1-6b6ade34b7ea admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.478909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab799a-51ae-4b28-beb1-6b6ade34b7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.479220 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab799a-51ae-4b28-beb1-6b6ade34b7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.479975 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab799a-51ae-4b28-beb1-6b6ade34b7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.481600 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab799a-51ae-4b28-beb1-6b6ade34b7ea admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.492225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1373/2724] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:54.498706 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab799a-51ae-4b28-beb1-6b6ade34b7ea admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.508894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab799a-51ae-4b28-beb1-6b6ade34b7ea admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.514500 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff830-5d3c-46b9-a28d-02a65da7ad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.515374 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff830-5d3c-46b9-a28d-02a65da7ad86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.515715 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff830-5d3c-46b9-a28d-02a65da7ad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.515938 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff830-5d3c-46b9-a28d-02a65da7ad86 admin admin] PATH_INFO: `/v3/projects/cc508ee00dd64d929fa9cc03421f7105/users/9c87d3448e9348fcaf2962ea76143c1c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.535579 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff830-5d3c-46b9-a28d-02a65da7ad86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc508ee00dd64d929fa9cc03421f7105, user_id=9c87d3448e9348fcaf2962ea76143c1c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.540661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff830-5d3c-46b9-a28d-02a65da7ad86 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.555786 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1352/2725] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:54.559837 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54582c5c-9f3c-4d38-8ed4-ed7879b5d306 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.569743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54582c5c-9f3c-4d38-8ed4-ed7879b5d306 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.574684 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e249-e255-42d2-8e0b-7ccb1c1fb3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.575472 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e249-e255-42d2-8e0b-7ccb1c1fb3fb admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.575753 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e249-e255-42d2-8e0b-7ccb1c1fb3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.576027 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e249-e255-42d2-8e0b-7ccb1c1fb3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.576754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6e249-e255-42d2-8e0b-7ccb1c1fb3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.578364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6e249-e255-42d2-8e0b-7ccb1c1fb3fb admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.589942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1353/2726] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:54.593816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e249-e255-42d2-8e0b-7ccb1c1fb3fb admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.595286 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1374/2727] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:54 2022] PUT /identity/v3/projects/cc508ee00dd64d929fa9cc03421f7105/users/9c87d3448e9348fcaf2962ea76143c1c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:54.599047 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff830-5d3c-46b9-a28d-02a65da7ad86 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.604438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e249-e255-42d2-8e0b-7ccb1c1fb3fb admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.665730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff830-5d3c-46b9-a28d-02a65da7ad86 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.668164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3097acd-34eb-4d37-a643-3463fe4ce807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.668842 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3097acd-34eb-4d37-a643-3463fe4ce807 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.669128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3097acd-34eb-4d37-a643-3463fe4ce807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.669443 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3097acd-34eb-4d37-a643-3463fe4ce807 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.670198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3097acd-34eb-4d37-a643-3463fe4ce807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.671146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dbdd0-1c20-43ff-a4c3-07346f22be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.671887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3097acd-34eb-4d37-a643-3463fe4ce807 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.672352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dbdd0-1c20-43ff-a4c3-07346f22be23 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.672352 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dbdd0-1c20-43ff-a4c3-07346f22be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.672531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dbdd0-1c20-43ff-a4c3-07346f22be23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.673224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dbdd0-1c20-43ff-a4c3-07346f22be23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.674832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dbdd0-1c20-43ff-a4c3-07346f22be23 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.682559 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1354/2728] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:54.685010 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1375/2729] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:54.686626 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3097acd-34eb-4d37-a643-3463fe4ce807 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.688787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dbdd0-1c20-43ff-a4c3-07346f22be23 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.697096 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3097acd-34eb-4d37-a643-3463fe4ce807 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.698573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dbdd0-1c20-43ff-a4c3-07346f22be23 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.701833 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb1032-d346-4d65-8b99-20b62e474d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.702709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1032-d346-4d65-8b99-20b62e474d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.702995 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1032-d346-4d65-8b99-20b62e474d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.703214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a97c4e-77ae-4df4-80cd-952cc35b0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.703348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1032-d346-4d65-8b99-20b62e474d01 admin admin] PATH_INFO: `/v3/projects/b7f389004e4d4f3a922b487deeeed1e7/users/e273535c66ee4f1c91dae2164a632665/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.704103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a97c4e-77ae-4df4-80cd-952cc35b0130 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.704389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a97c4e-77ae-4df4-80cd-952cc35b0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.704671 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a97c4e-77ae-4df4-80cd-952cc35b0130 admin admin] PATH_INFO: `/v3/projects/cc508ee00dd64d929fa9cc03421f7105/users/9c87d3448e9348fcaf2962ea76143c1c/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.706743 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a97c4e-77ae-4df4-80cd-952cc35b0130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc508ee00dd64d929fa9cc03421f7105, user_id=9c87d3448e9348fcaf2962ea76143c1c, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.709446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a97c4e-77ae-4df4-80cd-952cc35b0130 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.719221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb1032-d346-4d65-8b99-20b62e474d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f389004e4d4f3a922b487deeeed1e7, user_id=e273535c66ee4f1c91dae2164a632665, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:54.720317 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1376/2730] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:54 2022] PUT /identity/v3/projects/cc508ee00dd64d929fa9cc03421f7105/users/9c87d3448e9348fcaf2962ea76143c1c/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:54.722095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb1032-d346-4d65-8b99-20b62e474d01 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:54.731649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4603deb-27b6-46bf-9064-12e97991eff8 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.732035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4603deb-27b6-46bf-9064-12e97991eff8 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.732381 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4603deb-27b6-46bf-9064-12e97991eff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.765320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a4603deb-27b6-46bf-9064-12e97991eff8 None None] MFA Rules not processed for user `9c87d3448e9348fcaf2962ea76143c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:54.766546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a4603deb-27b6-46bf-9064-12e97991eff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:54.817973 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1355/2731] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:54 2022] PUT /identity/v3/projects/b7f389004e4d4f3a922b487deeeed1e7/users/e273535c66ee4f1c91dae2164a632665/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:54.828210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064413f-d685-464d-ab80-f278e1944142 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.828210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064413f-d685-464d-ab80-f278e1944142 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.828210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064413f-d685-464d-ab80-f278e1944142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.837728 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-6064413f-d685-464d-ab80-f278e1944142 None None] MFA Rules not processed for user `a41697666e4d41b8a362d18e539facd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:54.838345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1377/2732] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:54.839031 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6064413f-d685-464d-ab80-f278e1944142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:54.841033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f5ae2-7754-4be7-8b13-99937429de9d None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.841159 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f5ae2-7754-4be7-8b13-99937429de9d None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.841452 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f5ae2-7754-4be7-8b13-99937429de9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:54.871258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4f7f5ae2-7754-4be7-8b13-99937429de9d None None] MFA Rules not processed for user `e273535c66ee4f1c91dae2164a632665`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:54.872483 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4f7f5ae2-7754-4be7-8b13-99937429de9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:54.897638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1356/2733] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:54.898939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064413f-d685-464d-ab80-f278e1944142 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.900119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-6064413f-d685-464d-ab80-f278e1944142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:54.941048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1378/2734] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:54.946071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f5ae2-7754-4be7-8b13-99937429de9d None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:54.962980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064413f-d685-464d-ab80-f278e1944142 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:54.967114 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d9c7a-bddb-4bfe-a257-09ebb006efb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:54.967557 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9c7a-bddb-4bfe-a257-09ebb006efb1 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:54.967851 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9c7a-bddb-4bfe-a257-09ebb006efb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:54.968116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d9c7a-bddb-4bfe-a257-09ebb006efb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.024147 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f5ae2-7754-4be7-8b13-99937429de9d None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:55.030373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8c8f-349d-475f-a24e-01ffc40ac715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:55.031126 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8c8f-349d-475f-a24e-01ffc40ac715 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.031479 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8c8f-349d-475f-a24e-01ffc40ac715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.031846 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8c8f-349d-475f-a24e-01ffc40ac715 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.032614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8c8f-349d-475f-a24e-01ffc40ac715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.034776 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8c8f-349d-475f-a24e-01ffc40ac715 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.041447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d9c7a-bddb-4bfe-a257-09ebb006efb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.042905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d9c7a-bddb-4bfe-a257-09ebb006efb1 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.053095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1357/2735] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:55.081423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d9c7a-bddb-4bfe-a257-09ebb006efb1 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:55.092970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d9c7a-bddb-4bfe-a257-09ebb006efb1 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:55.096782 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:55.097778 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.098147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.098494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] PATH_INFO: `/v3/users/120a601dc0d34269bc5b09009090507a` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.099781 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=120a601dc0d34269bc5b09009090507a)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.102695 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.129529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1379/2736] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:54 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:55.134222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8c8f-349d-475f-a24e-01ffc40ac715 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:55.202882 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8c8f-349d-475f-a24e-01ffc40ac715 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:55.207601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4560cc-552f-4b43-8812-b1e1bf205597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:55.208273 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4560cc-552f-4b43-8812-b1e1bf205597 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.208560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4560cc-552f-4b43-8812-b1e1bf205597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.208838 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4560cc-552f-4b43-8812-b1e1bf205597 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.209570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4560cc-552f-4b43-8812-b1e1bf205597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.211780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4560cc-552f-4b43-8812-b1e1bf205597 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.315554 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1380/2737] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:55 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:55.319529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4560cc-552f-4b43-8812-b1e1bf205597 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:55.329216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4560cc-552f-4b43-8812-b1e1bf205597 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:55.333873 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fcd19-d4c7-4db1-b264-d064036da29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:55.334547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fcd19-d4c7-4db1-b264-d064036da29b admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.334828 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fcd19-d4c7-4db1-b264-d064036da29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.335109 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fcd19-d4c7-4db1-b264-d064036da29b admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.336585 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fcd19-d4c7-4db1-b264-d064036da29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.338226 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fcd19-d4c7-4db1-b264-d064036da29b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.350819 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1381/2738] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:55.355982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fcd19-d4c7-4db1-b264-d064036da29b admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:55.360702 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120a601dc0d34269bc5b09009090507a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:55.366466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fcd19-d4c7-4db1-b264-d064036da29b admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:55.371494 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:55.372192 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.372477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.372756 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.373393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120a601dc0d34269bc5b09009090507a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:55.373527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.374121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120a601dc0d34269bc5b09009090507a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:55.374679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120a601dc0d34269bc5b09009090507a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:55.375283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.387677 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1382/2739] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:55.392195 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:55.394189 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:55.408390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bdd9e-0ec6-4a48-a079-8b9cc9b489b6 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:55.413566 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad127c-8125-4d6d-b8ee-8b5bcd036ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:55.415369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad127c-8125-4d6d-b8ee-8b5bcd036ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.415653 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad127c-8125-4d6d-b8ee-8b5bcd036ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.415934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad127c-8125-4d6d-b8ee-8b5bcd036ccb admin admin] PATH_INFO: `/v3/projects/3862413d8ebd444986c551533ff8174e/users/aaadc0a46c2840e58a11a45b0ef3814e/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.431541 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad127c-8125-4d6d-b8ee-8b5bcd036ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3862413d8ebd444986c551533ff8174e, user_id=aaadc0a46c2840e58a11a45b0ef3814e, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.434434 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad127c-8125-4d6d-b8ee-8b5bcd036ccb admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.497867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e8e7ae7b-2f62-4d46-9c2d-2899d7e4a3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120a601dc0d34269bc5b09009090507a'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:55.510890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1358/2740] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:55 2022] DELETE /identity/v3/users/120a601dc0d34269bc5b09009090507a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:55.515232 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c912f2-1da5-445f-99e0-3083d3425880 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.515523 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c912f2-1da5-445f-99e0-3083d3425880 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.515805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c912f2-1da5-445f-99e0-3083d3425880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.532997 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-30c912f2-1da5-445f-99e0-3083d3425880 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:55.534339 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-30c912f2-1da5-445f-99e0-3083d3425880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:55.544574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1383/2741] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:55 2022] PUT /identity/v3/projects/3862413d8ebd444986c551533ff8174e/users/aaadc0a46c2840e58a11a45b0ef3814e/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:55.559256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3d8e-acd0-4e64-b60e-3fdbb5f429b1 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.559550 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3d8e-acd0-4e64-b60e-3fdbb5f429b1 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.559971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3d8e-acd0-4e64-b60e-3fdbb5f429b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.587934 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-272c3d8e-acd0-4e64-b60e-3fdbb5f429b1 None None] MFA Rules not processed for user `aaadc0a46c2840e58a11a45b0ef3814e`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:55.590237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-272c3d8e-acd0-4e64-b60e-3fdbb5f429b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:55.600963 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1359/2742] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:55.611700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c912f2-1da5-445f-99e0-3083d3425880 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:55.613580 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-30c912f2-1da5-445f-99e0-3083d3425880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:55.688477 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c912f2-1da5-445f-99e0-3083d3425880 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:55.719382 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1384/2743] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:55.723806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c3d8e-acd0-4e64-b60e-3fdbb5f429b1 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:55.741648 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c489-2130-4ff3-aecb-2749feeb9e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:55.743750 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c489-2130-4ff3-aecb-2749feeb9e84 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.743985 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c489-2130-4ff3-aecb-2749feeb9e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.744342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c489-2130-4ff3-aecb-2749feeb9e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.801180 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c3d8e-acd0-4e64-b60e-3fdbb5f429b1 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:55.807033 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb781b-875e-4cf5-9b54-3ba383b1d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:55.807746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb781b-875e-4cf5-9b54-3ba383b1d592 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:55.808060 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb781b-875e-4cf5-9b54-3ba383b1d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:55.808345 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb781b-875e-4cf5-9b54-3ba383b1d592 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:55.809078 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb781b-875e-4cf5-9b54-3ba383b1d592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.811019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb781b-875e-4cf5-9b54-3ba383b1d592 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.815003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7c489-2130-4ff3-aecb-2749feeb9e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:55.816459 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7c489-2130-4ff3-aecb-2749feeb9e84 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:55.826888 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1360/2744] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:55.939043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1385/2745] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:55 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:55.943234 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c489-2130-4ff3-aecb-2749feeb9e84 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:55.954052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c489-2130-4ff3-aecb-2749feeb9e84 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:56.015812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d781b-b2c4-4f44-8972-4075af847fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:56.016493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d781b-b2c4-4f44-8972-4075af847fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.016775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d781b-b2c4-4f44-8972-4075af847fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.017053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d781b-b2c4-4f44-8972-4075af847fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.017768 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d781b-b2c4-4f44-8972-4075af847fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:56.019754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d781b-b2c4-4f44-8972-4075af847fc0 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:56.101939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1361/2746] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:55 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:56.103719 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb781b-875e-4cf5-9b54-3ba383b1d592 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:56.123267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb781b-875e-4cf5-9b54-3ba383b1d592 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:56.129766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6f192-6a31-4144-b753-6144d6856978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:56.131745 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f192-6a31-4144-b753-6144d6856978 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.132092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f192-6a31-4144-b753-6144d6856978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.132423 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f192-6a31-4144-b753-6144d6856978 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.134018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6f192-6a31-4144-b753-6144d6856978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:56.136012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6f192-6a31-4144-b753-6144d6856978 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:56.147711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1386/2747] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:56.152222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d781b-b2c4-4f44-8972-4075af847fc0 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:56.163251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d781b-b2c4-4f44-8972-4075af847fc0 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:56.168814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:56.169685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] REQUEST_METHOD: `PUT` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.169965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.170239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] PATH_INFO: `/v3/projects/3cf5c0ea7cc24939940717bebd235d02/users/2e38f45b4a1c4e4ea9a3797f72ba9ea0/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.187921 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf5c0ea7cc24939940717bebd235d02, user_id=2e38f45b4a1c4e4ea9a3797f72ba9ea0, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:56.190957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:56.265765 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1362/2748] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:56 2022] PUT /identity/v3/projects/3cf5c0ea7cc24939940717bebd235d02/users/2e38f45b4a1c4e4ea9a3797f72ba9ea0/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:56.269619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6f192-6a31-4144-b753-6144d6856978 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:56.280702 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6f192-6a31-4144-b753-6144d6856978 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:56.340844 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f0b0-d9c0-4197-8368-0ab9b52471f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:56.341682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f0b0-d9c0-4197-8368-0ab9b52471f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.342020 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f0b0-d9c0-4197-8368-0ab9b52471f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.342388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f0b0-d9c0-4197-8368-0ab9b52471f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.343197 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f0b0-d9c0-4197-8368-0ab9b52471f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:56.344808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f0b0-d9c0-4197-8368-0ab9b52471f8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:56.352047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:56.353942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:56.375253 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096af5a-6fef-4dc6-9766-ea8bb62aa10c admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:56.376326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1387/2749] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:56.381268 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:56.382244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.383259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.383603 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] PATH_INFO: `/v3/projects/9e6c6e98588e4e518f7fed7423539b30` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.386108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f0b0-d9c0-4197-8368-0ab9b52471f8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:56.391700 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6c6e98588e4e518f7fed7423539b30)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:56.393828 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:56.400293 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f0b0-d9c0-4197-8368-0ab9b52471f8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:56.408224 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b5219-de2c-4f84-b9c1-ae689f3c85ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:56.409143 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b5219-de2c-4f84-b9c1-ae689f3c85ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.409456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b5219-de2c-4f84-b9c1-ae689f3c85ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.409765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b5219-de2c-4f84-b9c1-ae689f3c85ea admin admin] PATH_INFO: `/v3/projects/3cf5c0ea7cc24939940717bebd235d02/users/2e38f45b4a1c4e4ea9a3797f72ba9ea0/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.413154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b5219-de2c-4f84-b9c1-ae689f3c85ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf5c0ea7cc24939940717bebd235d02, user_id=2e38f45b4a1c4e4ea9a3797f72ba9ea0, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:56.416980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b5219-de2c-4f84-b9c1-ae689f3c85ea admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:56.431522 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1388/2750] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:56 2022] PUT /identity/v3/projects/3cf5c0ea7cc24939940717bebd235d02/users/2e38f45b4a1c4e4ea9a3797f72ba9ea0/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:56.439703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54cbc-5c24-4d88-b3b5-3901ba38a055 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.439998 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54cbc-5c24-4d88-b3b5-3901ba38a055 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.440281 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54cbc-5c24-4d88-b3b5-3901ba38a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.474030 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-4cf54cbc-5c24-4d88-b3b5-3901ba38a055 None None] MFA Rules not processed for user `2e38f45b4a1c4e4ea9a3797f72ba9ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:56.475225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4cf54cbc-5c24-4d88-b3b5-3901ba38a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:56.533057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6c6e98588e4e518f7fed7423539b30', 'request_id': 'req-ef75e97e-3732-419c-8f74-b55d05c22248'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:56.546524 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1389/2751] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:56.565733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf54cbc-5c24-4d88-b3b5-3901ba38a055 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:56.567103 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4cf54cbc-5c24-4d88-b3b5-3901ba38a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:56.611831 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6c6e98588e4e518f7fed7423539b30', 'request_id': 'req-ef75e97e-3732-419c-8f74-b55d05c22248'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:56.618342 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6c6e98588e4e518f7fed7423539b30', 'request_id': 'req-ef75e97e-3732-419c-8f74-b55d05c22248'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:56.627108 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf54cbc-5c24-4d88-b3b5-3901ba38a055 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:56.629722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] The token cache is being invalidate because project 9e6c6e98588e4e518f7fed7423539b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:56.630002 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:56.630675 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:56.632244 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1363/2752] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:56 2022] DELETE /identity/v3/projects/9e6c6e98588e4e518f7fed7423539b30 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:56.636890 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:56.638270 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:56.681026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:56.681786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.682011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.682294 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.684112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:56.719045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75e97e-3732-419c-8f74-b55d05c22248 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:56.725980 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:56.727224 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:56.727769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:56.728276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] PATH_INFO: `/v3/users/9c87d3448e9348fcaf2962ea76143c1c` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:56.729849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c87d3448e9348fcaf2962ea76143c1c)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:56.732616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:56.761480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:56.762957 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:56.772886 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1390/2753] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:57.016650 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c87d3448e9348fcaf2962ea76143c1c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.029094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c87d3448e9348fcaf2962ea76143c1c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.029864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c87d3448e9348fcaf2962ea76143c1c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.030547 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c87d3448e9348fcaf2962ea76143c1c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.120579 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-4ba44422-c461-4067-8b44-ecf55ffa6541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c87d3448e9348fcaf2962ea76143c1c'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.133380 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1364/2754] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:12:56 2022] DELETE /identity/v3/users/9c87d3448e9348fcaf2962ea76143c1c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:12:57.564571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:57.575070 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624b097-62ca-4bce-b90a-3211649c49e9 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:57.635980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:57.637075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:57.637206 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:57.637603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] PATH_INFO: `/v3/projects/cc508ee00dd64d929fa9cc03421f7105` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:57.638894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc508ee00dd64d929fa9cc03421f7105)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:57.641881 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:57.794712 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc508ee00dd64d929fa9cc03421f7105', 'request_id': 'req-2a0d1b9d-ce25-4d22-9382-44af1787be74'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.889560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc508ee00dd64d929fa9cc03421f7105', 'request_id': 'req-2a0d1b9d-ce25-4d22-9382-44af1787be74'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.892593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc508ee00dd64d929fa9cc03421f7105', 'request_id': 'req-2a0d1b9d-ce25-4d22-9382-44af1787be74'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.903691 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] The token cache is being invalidate because project cc508ee00dd64d929fa9cc03421f7105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:12:57.903983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.904650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-2a0d1b9d-ce25-4d22-9382-44af1787be74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:12:57.906262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1391/2755] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:12:57 2022] DELETE /identity/v3/projects/cc508ee00dd64d929fa9cc03421f7105 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:57.911098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13627-d51d-4a50-a09d-8b5951dd0ff5 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:57.911578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13627-d51d-4a50-a09d-8b5951dd0ff5 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:57.911688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13627-d51d-4a50-a09d-8b5951dd0ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:57.931015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-89d13627-d51d-4a50-a09d-8b5951dd0ff5 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:57.932227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-89d13627-d51d-4a50-a09d-8b5951dd0ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:57.991334 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1365/2756] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:57.999569 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24480a8-515a-4b06-8ed6-9714b0b1a83e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.004016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24480a8-515a-4b06-8ed6-9714b0b1a83e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.004016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24480a8-515a-4b06-8ed6-9714b0b1a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.018681 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c24480a8-515a-4b06-8ed6-9714b0b1a83e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:58.019884 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c24480a8-515a-4b06-8ed6-9714b0b1a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:58.028574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1392/2757] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:12:58.038520 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d13627-d51d-4a50-a09d-8b5951dd0ff5 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:58.043632 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d13627-d51d-4a50-a09d-8b5951dd0ff5 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:58.048136 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:58.048783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.049062 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.049373 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.050095 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:12:58.050402 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:58.051990 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:58.067929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1366/2758] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:12:58.070794 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24480a8-515a-4b06-8ed6-9714b0b1a83e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:58.081307 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24480a8-515a-4b06-8ed6-9714b0b1a83e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:58.086175 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35a14f-f78f-4f9a-96c9-420d973664f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:58.086836 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35a14f-f78f-4f9a-96c9-420d973664f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.087130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35a14f-f78f-4f9a-96c9-420d973664f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.087412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35a14f-f78f-4f9a-96c9-420d973664f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.088102 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35a14f-f78f-4f9a-96c9-420d973664f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:58.090090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35a14f-f78f-4f9a-96c9-420d973664f7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:58.220002 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1393/2759] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:58 2022] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:58.224264 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:58.234697 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975c384-a7a5-4a25-99b1-3417005d68c8 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:58.293826 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb47b9-1190-47a9-95a1-04b9874d8146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:58.294522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb47b9-1190-47a9-95a1-04b9874d8146 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.294801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb47b9-1190-47a9-95a1-04b9874d8146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.295079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb47b9-1190-47a9-95a1-04b9874d8146 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.295758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb47b9-1190-47a9-95a1-04b9874d8146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:58.297686 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb47b9-1190-47a9-95a1-04b9874d8146 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:58.425054 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1367/2760] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:58 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:58.429283 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35a14f-f78f-4f9a-96c9-420d973664f7 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:58.439945 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35a14f-f78f-4f9a-96c9-420d973664f7 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:58.444710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cd817-9150-4a00-a06e-cb6168341c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:58.445544 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd817-9150-4a00-a06e-cb6168341c52 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.445833 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd817-9150-4a00-a06e-cb6168341c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.446115 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cd817-9150-4a00-a06e-cb6168341c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.446856 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cd817-9150-4a00-a06e-cb6168341c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:58.448894 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cd817-9150-4a00-a06e-cb6168341c52 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:58.460021 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1394/2761] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:58.464951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb47b9-1190-47a9-95a1-04b9874d8146 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:58.474892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb47b9-1190-47a9-95a1-04b9874d8146 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:58.480801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb4cec-d5b2-4898-b42b-5b4c28541492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:58.481668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb4cec-d5b2-4898-b42b-5b4c28541492 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.482015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb4cec-d5b2-4898-b42b-5b4c28541492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.482351 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb4cec-d5b2-4898-b42b-5b4c28541492 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.483199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb4cec-d5b2-4898-b42b-5b4c28541492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:58.487335 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb4cec-d5b2-4898-b42b-5b4c28541492 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:58.501855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1368/2762] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:12:58.509553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cd817-9150-4a00-a06e-cb6168341c52 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:58.515504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cd817-9150-4a00-a06e-cb6168341c52 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:58.520989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585ea5b-10ce-4c7b-870a-d8b7ffa15232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:58.522373 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585ea5b-10ce-4c7b-870a-d8b7ffa15232 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.522786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585ea5b-10ce-4c7b-870a-d8b7ffa15232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.523129 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585ea5b-10ce-4c7b-870a-d8b7ffa15232 admin admin] PATH_INFO: `/v3/projects/1a186d4c4ece4e13a654ff72ccea67f6/users/f010703464ed4d71beecac5697912ff1/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.542588 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585ea5b-10ce-4c7b-870a-d8b7ffa15232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a186d4c4ece4e13a654ff72ccea67f6, user_id=f010703464ed4d71beecac5697912ff1, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:58.545728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585ea5b-10ce-4c7b-870a-d8b7ffa15232 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:58.681549 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1395/2763] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:58 2022] PUT /identity/v3/projects/1a186d4c4ece4e13a654ff72ccea67f6/users/f010703464ed4d71beecac5697912ff1/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:58.699430 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bec11-6849-48af-b68f-176411f9a777 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.699722 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bec11-6849-48af-b68f-176411f9a777 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.700003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bec11-6849-48af-b68f-176411f9a777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.727198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e79bec11-6849-48af-b68f-176411f9a777 None None] MFA Rules not processed for user `f010703464ed4d71beecac5697912ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:58.728424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e79bec11-6849-48af-b68f-176411f9a777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:58.806431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1369/2764] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:58.811650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585ea5b-10ce-4c7b-870a-d8b7ffa15232 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:58.918075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585ea5b-10ce-4c7b-870a-d8b7ffa15232 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:58.934918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50c5f-c4a4-4982-be0f-5a076d00d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:58.934918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50c5f-c4a4-4982-be0f-5a076d00d42d admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:58.934918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50c5f-c4a4-4982-be0f-5a076d00d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:58.934918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b50c5f-c4a4-4982-be0f-5a076d00d42d admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:58.935714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b50c5f-c4a4-4982-be0f-5a076d00d42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:58.938467 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b50c5f-c4a4-4982-be0f-5a076d00d42d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:58.953421 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bec11-6849-48af-b68f-176411f9a777 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:58.955037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e79bec11-6849-48af-b68f-176411f9a777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:59.021119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bec11-6849-48af-b68f-176411f9a777 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:59.034717 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:59.035447 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.035947 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.036428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.038971 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:59.042649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1396/2765] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:12:58 2022] POST /identity/v3/projects => generated 391 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:12:59.047135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50c5f-c4a4-4982-be0f-5a076d00d42d admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:59.110145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:59.111638 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:59.115107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b50c5f-c4a4-4982-be0f-5a076d00d42d admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:59.121265 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ddbd1-0a8d-4482-b8d2-00d606eca3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:59.122080 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddbd1-0a8d-4482-b8d2-00d606eca3cb admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.122687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddbd1-0a8d-4482-b8d2-00d606eca3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.122817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1370/2766] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:12:59.122964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ddbd1-0a8d-4482-b8d2-00d606eca3cb admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.123552 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ddbd1-0a8d-4482-b8d2-00d606eca3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:59.125595 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ddbd1-0a8d-4482-b8d2-00d606eca3cb admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:59.215359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1397/2767] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:12:59 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:12:59.216584 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:59.227020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20454d1-0049-4bd8-bd7b-a900bd62ab36 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:59.232200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282970b8-4971-4919-87b4-bff3eea96ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:59.232857 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282970b8-4971-4919-87b4-bff3eea96ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.233146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282970b8-4971-4919-87b4-bff3eea96ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.233456 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282970b8-4971-4919-87b4-bff3eea96ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.234182 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282970b8-4971-4919-87b4-bff3eea96ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:59.235779 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282970b8-4971-4919-87b4-bff3eea96ff1 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:59.247604 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1371/2768] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:59.251446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ddbd1-0a8d-4482-b8d2-00d606eca3cb admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:59.262414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ddbd1-0a8d-4482-b8d2-00d606eca3cb admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:59.267654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32656fff-d2f4-4961-9e7c-2b6a7bf3483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:59.270400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32656fff-d2f4-4961-9e7c-2b6a7bf3483c admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.270400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32656fff-d2f4-4961-9e7c-2b6a7bf3483c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.270400 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32656fff-d2f4-4961-9e7c-2b6a7bf3483c admin admin] PATH_INFO: `/v3/projects/eb6e856732d1494dab8094c2dc3beb76/users/c9e18bce744e42a3a9b5dc5b037168df/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.285188 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32656fff-d2f4-4961-9e7c-2b6a7bf3483c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6e856732d1494dab8094c2dc3beb76, user_id=c9e18bce744e42a3a9b5dc5b037168df, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:59.287867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32656fff-d2f4-4961-9e7c-2b6a7bf3483c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:59.390763 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1398/2769] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:59 2022] PUT /identity/v3/projects/eb6e856732d1494dab8094c2dc3beb76/users/c9e18bce744e42a3a9b5dc5b037168df/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:59.395273 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282970b8-4971-4919-87b4-bff3eea96ff1 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:59.407644 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282970b8-4971-4919-87b4-bff3eea96ff1 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:59.467729 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16604cc0-cecb-4564-b209-91ae6fb9dfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:59.468319 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604cc0-cecb-4564-b209-91ae6fb9dfec admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.468602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604cc0-cecb-4564-b209-91ae6fb9dfec admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.468876 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604cc0-cecb-4564-b209-91ae6fb9dfec admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.469639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16604cc0-cecb-4564-b209-91ae6fb9dfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:59.471366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16604cc0-cecb-4564-b209-91ae6fb9dfec admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:59.482242 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1372/2770] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:12:59.487114 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32656fff-d2f4-4961-9e7c-2b6a7bf3483c admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:59.499601 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32656fff-d2f4-4961-9e7c-2b6a7bf3483c admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:59.504395 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:59.508031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.508031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.508031 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] PATH_INFO: `/v3/projects/eb6e856732d1494dab8094c2dc3beb76/users/c9e18bce744e42a3a9b5dc5b037168df/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.508295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6e856732d1494dab8094c2dc3beb76, user_id=c9e18bce744e42a3a9b5dc5b037168df, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:59.512094 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:59.523650 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1399/2771] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:12:59 2022] PUT /identity/v3/projects/eb6e856732d1494dab8094c2dc3beb76/users/c9e18bce744e42a3a9b5dc5b037168df/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:12:59.535282 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710dc06-1489-4a5f-ac5d-6df1bfb1cb3d None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.535685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710dc06-1489-4a5f-ac5d-6df1bfb1cb3d None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.536047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710dc06-1489-4a5f-ac5d-6df1bfb1cb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.565376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-2710dc06-1489-4a5f-ac5d-6df1bfb1cb3d None None] MFA Rules not processed for user `c9e18bce744e42a3a9b5dc5b037168df`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:12:59.566571 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2710dc06-1489-4a5f-ac5d-6df1bfb1cb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:59.641708 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1373/2772] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:12:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:12:59.654135 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:59.655964 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:12:59.721427 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8f2d-84d3-48cb-8b8b-99e865fadb8e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:59.726037 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e7fad-2e1f-49ff-8ce3-622044cd2567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:59.726720 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7fad-2e1f-49ff-8ce3-622044cd2567 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.727006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7fad-2e1f-49ff-8ce3-622044cd2567 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.727284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e7fad-2e1f-49ff-8ce3-622044cd2567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.739130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e7fad-2e1f-49ff-8ce3-622044cd2567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:59.741418 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e7fad-2e1f-49ff-8ce3-622044cd2567 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:59.756295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1400/2773] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:12:59.808485 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710dc06-1489-4a5f-ac5d-6df1bfb1cb3d None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:12:59.818754 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710dc06-1489-4a5f-ac5d-6df1bfb1cb3d None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:12:59.823400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756730-3792-466f-b54a-fa1e65d40925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:12:59.824084 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756730-3792-466f-b54a-fa1e65d40925 service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:12:59.824370 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756730-3792-466f-b54a-fa1e65d40925 service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:12:59.824651 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756730-3792-466f-b54a-fa1e65d40925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:12:59.892725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756730-3792-466f-b54a-fa1e65d40925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:12:59.894260 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc756730-3792-466f-b54a-fa1e65d40925 service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:12:59.906102 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1374/2774] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:12:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:00.759216 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e7fad-2e1f-49ff-8ce3-622044cd2567 service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:00.761042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e7fad-2e1f-49ff-8ce3-622044cd2567 service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:00.766284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018216f-d964-4e52-a1cb-f288a450c903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:00.767313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018216f-d964-4e52-a1cb-f288a450c903 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:00.767599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018216f-d964-4e52-a1cb-f288a450c903 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:00.769074 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018216f-d964-4e52-a1cb-f288a450c903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:00.771812 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-8018216f-d964-4e52-a1cb-f288a450c903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:00.866248 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018216f-d964-4e52-a1cb-f288a450c903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:00.867858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018216f-d964-4e52-a1cb-f288a450c903 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:00.879593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1401/2775] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:04.860998 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756730-3792-466f-b54a-fa1e65d40925 service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:04.925281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756730-3792-466f-b54a-fa1e65d40925 service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:04.929841 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:04.930704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:04.931018 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:04.931254 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] PATH_INFO: `/v3/users/f010703464ed4d71beecac5697912ff1` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:04.933055 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f010703464ed4d71beecac5697912ff1)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:04.935003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:05.166776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f010703464ed4d71beecac5697912ff1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:05.180006 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f010703464ed4d71beecac5697912ff1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:05.180925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f010703464ed4d71beecac5697912ff1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:05.182310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f010703464ed4d71beecac5697912ff1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:05.285867 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f010703464ed4d71beecac5697912ff1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:05.300690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1375/2776] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:04 2022] DELETE /identity/v3/users/f010703464ed4d71beecac5697912ff1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:05.305340 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5ca7-b4a1-4184-ba8f-d57afbe6bedd None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:05.305830 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5ca7-b4a1-4184-ba8f-d57afbe6bedd None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:05.306018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a5ca7-b4a1-4184-ba8f-d57afbe6bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:05.325209 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-7b2a5ca7-b4a1-4184-ba8f-d57afbe6bedd None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:05.331025 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7b2a5ca7-b4a1-4184-ba8f-d57afbe6bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:05.394690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1402/2777] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:13:05.404801 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:05.406265 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:05.466581 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1f355-ba00-46eb-a440-72bef98bfdfc admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:05.470502 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:05.471152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:05.471431 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:05.471712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:05.481690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:05.483128 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:05.493094 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1376/2778] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:05.572796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a5ca7-b4a1-4184-ba8f-d57afbe6bedd None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:05.573473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7b2a5ca7-b4a1-4184-ba8f-d57afbe6bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:05.585573 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a5ca7-b4a1-4184-ba8f-d57afbe6bedd None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:05.591429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:05.592101 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:05.592386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:05.592661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:05.594486 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:05.657806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:05.659177 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:05.669313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1403/2779] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 14:13:05.830246 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:05.831656 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:05.844352 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c328c-21f6-48e5-a43e-03aa2e048a8d service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:05.849076 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:05.850015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:05.850330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:05.850583 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] PATH_INFO: `/v3/users/e273535c66ee4f1c91dae2164a632665` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:05.851787 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e273535c66ee4f1c91dae2164a632665)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:05.853799 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:05.950875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:05.956813 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:05.966875 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caf9f8-b325-44af-8678-d0cbbb4f5a98 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:05.971604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:05.972498 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:05.972780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:05.973057 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] PATH_INFO: `/v3/projects/1a186d4c4ece4e13a654ff72ccea67f6` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:05.974288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a186d4c4ece4e13a654ff72ccea67f6)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:05.976597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:06.077173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e273535c66ee4f1c91dae2164a632665'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.089277 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e273535c66ee4f1c91dae2164a632665'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.090155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e273535c66ee4f1c91dae2164a632665'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.090776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e273535c66ee4f1c91dae2164a632665'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.112866 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a186d4c4ece4e13a654ff72ccea67f6', 'request_id': 'req-53b6d745-5030-4501-b096-667c3f5c90ed'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.189085 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-280a8261-a72f-43cb-9541-9837e7d58b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e273535c66ee4f1c91dae2164a632665'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.204418 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1377/2780] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:05 2022] DELETE /identity/v3/users/e273535c66ee4f1c91dae2164a632665 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:06.208953 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239395a-a171-4e00-a3f4-af39d7d1135c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:06.209328 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239395a-a171-4e00-a3f4-af39d7d1135c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:06.209760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239395a-a171-4e00-a3f4-af39d7d1135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:06.227986 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-b239395a-a171-4e00-a3f4-af39d7d1135c None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:06.232315 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b239395a-a171-4e00-a3f4-af39d7d1135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:06.251430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a186d4c4ece4e13a654ff72ccea67f6', 'request_id': 'req-53b6d745-5030-4501-b096-667c3f5c90ed'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.258097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a186d4c4ece4e13a654ff72ccea67f6', 'request_id': 'req-53b6d745-5030-4501-b096-667c3f5c90ed'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.270930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] The token cache is being invalidate because project 1a186d4c4ece4e13a654ff72ccea67f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:06.271230 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.273755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.279028 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1404/2781] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:05 2022] DELETE /identity/v3/projects/1a186d4c4ece4e13a654ff72ccea67f6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:13:06.280110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:06.281682 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:06.293355 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1378/2782] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:13:06.302704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239395a-a171-4e00-a3f4-af39d7d1135c None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:06.304278 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b239395a-a171-4e00-a3f4-af39d7d1135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:06.355627 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d745-5030-4501-b096-667c3f5c90ed admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:06.362221 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:06.363110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:06.363386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:06.363852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] PATH_INFO: `/v3/users/c9e18bce744e42a3a9b5dc5b037168df` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:06.366252 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e18bce744e42a3a9b5dc5b037168df)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:06.368167 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:06.374929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239395a-a171-4e00-a3f4-af39d7d1135c None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:06.379647 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:06.380324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:06.380610 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:06.380891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:06.413554 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:06.415445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:06.429522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1379/2783] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:06.610947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e18bce744e42a3a9b5dc5b037168df'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.625358 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e18bce744e42a3a9b5dc5b037168df'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.626545 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e18bce744e42a3a9b5dc5b037168df'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.627222 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e18bce744e42a3a9b5dc5b037168df'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.704436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e18bce744e42a3a9b5dc5b037168df'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:06.731852 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1405/2784] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:06 2022] DELETE /identity/v3/users/c9e18bce744e42a3a9b5dc5b037168df => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:07.104685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:07.104685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:07.120125 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c79e-5f9f-4987-86f5-67af277bf7e5 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:07.202938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:07.203884 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:07.204187 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:07.204462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] PATH_INFO: `/v3/projects/b7f389004e4d4f3a922b487deeeed1e7` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:07.205859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f389004e4d4f3a922b487deeeed1e7)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:07.208010 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:07.323601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f389004e4d4f3a922b487deeeed1e7', 'request_id': 'req-ecf29256-f71a-43aa-a780-aaa27fcb8596'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.434361 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f389004e4d4f3a922b487deeeed1e7', 'request_id': 'req-ecf29256-f71a-43aa-a780-aaa27fcb8596'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.440471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f389004e4d4f3a922b487deeeed1e7', 'request_id': 'req-ecf29256-f71a-43aa-a780-aaa27fcb8596'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.451789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] The token cache is being invalidate because project b7f389004e4d4f3a922b487deeeed1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:07.452080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.452725 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.454316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1380/2785] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:07 2022] DELETE /identity/v3/projects/b7f389004e4d4f3a922b487deeeed1e7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:07.458369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:07.459825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:07.473475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65f1ee-ee61-452f-a8d3-82bcef9737c2 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:07.526173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:07.526173 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:07.534022 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:07.534905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:07.535184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:07.535456 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] PATH_INFO: `/v3/users/aaadc0a46c2840e58a11a45b0ef3814e` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:07.537017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaadc0a46c2840e58a11a45b0ef3814e)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:07.543378 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:07.599372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29256-f71a-43aa-a780-aaa27fcb8596 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:07.608960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:07.610743 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:07.611103 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:07.611466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] PATH_INFO: `/v3/projects/eb6e856732d1494dab8094c2dc3beb76` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:07.612892 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6e856732d1494dab8094c2dc3beb76)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:07.615769 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:07.783618 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6e856732d1494dab8094c2dc3beb76', 'request_id': 'req-2d313b3c-cb7b-411b-bd87-62c00611ac69'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.787736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaadc0a46c2840e58a11a45b0ef3814e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.801185 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaadc0a46c2840e58a11a45b0ef3814e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.801946 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaadc0a46c2840e58a11a45b0ef3814e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.802616 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaadc0a46c2840e58a11a45b0ef3814e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.863879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6e856732d1494dab8094c2dc3beb76', 'request_id': 'req-2d313b3c-cb7b-411b-bd87-62c00611ac69'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.870597 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6e856732d1494dab8094c2dc3beb76', 'request_id': 'req-2d313b3c-cb7b-411b-bd87-62c00611ac69'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.882343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] The token cache is being invalidate because project eb6e856732d1494dab8094c2dc3beb76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:07.882635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.883323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2d313b3c-cb7b-411b-bd87-62c00611ac69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.885167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1381/2786] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:07 2022] DELETE /identity/v3/projects/eb6e856732d1494dab8094c2dc3beb76 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:13:07.891353 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4c83e-7572-446d-a004-333284beb983 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:07.891770 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4c83e-7572-446d-a004-333284beb983 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:07.892050 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4c83e-7572-446d-a004-333284beb983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:07.911494 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e5e4c83e-7572-446d-a004-333284beb983 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:07.912694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e5e4c83e-7572-446d-a004-333284beb983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:07.937800 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-8cc9cf04-22ff-4565-bc4c-c2366e33629d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaadc0a46c2840e58a11a45b0ef3814e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:07.955652 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1406/2787] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:07 2022] DELETE /identity/v3/users/aaadc0a46c2840e58a11a45b0ef3814e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:07.979396 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1382/2788] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:13:07.988553 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c595ff-a6ef-4f02-8171-7036cbc9cf92 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:07.988845 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c595ff-a6ef-4f02-8171-7036cbc9cf92 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:07.989150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c595ff-a6ef-4f02-8171-7036cbc9cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.009947 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f3c595ff-a6ef-4f02-8171-7036cbc9cf92 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:08.011266 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f3c595ff-a6ef-4f02-8171-7036cbc9cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:08.074071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1407/2789] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:08.077898 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4c83e-7572-446d-a004-333284beb983 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.088200 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4c83e-7572-446d-a004-333284beb983 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.092938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.093667 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.093952 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.094229 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.094967 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:13:08.095275 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.096912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:08.112872 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1383/2790] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:13:08.119441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c595ff-a6ef-4f02-8171-7036cbc9cf92 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.129387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c595ff-a6ef-4f02-8171-7036cbc9cf92 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.134191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f00c6f-ab61-4941-b3cb-1779a64949d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.135262 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00c6f-ab61-4941-b3cb-1779a64949d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.135619 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00c6f-ab61-4941-b3cb-1779a64949d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.135924 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00c6f-ab61-4941-b3cb-1779a64949d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.136604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f00c6f-ab61-4941-b3cb-1779a64949d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.138816 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f00c6f-ab61-4941-b3cb-1779a64949d5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:08.232390 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1408/2791] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:13:08 2022] POST /identity/v3/projects => generated 407 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:13:08.235301 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.249608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50d9a4-c568-49e5-b14c-f8240ffa9507 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.319643 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e88173-b6a6-4430-bfa5-81138423d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.320346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88173-b6a6-4430-bfa5-81138423d0af admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.320681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88173-b6a6-4430-bfa5-81138423d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.321012 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e88173-b6a6-4430-bfa5-81138423d0af admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.321961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e88173-b6a6-4430-bfa5-81138423d0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.324621 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e88173-b6a6-4430-bfa5-81138423d0af admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:08.430325 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f00c6f-ab61-4941-b3cb-1779a64949d5 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.436965 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1384/2792] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:13:08 2022] POST /identity/v3/users => generated 304 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:13:08.443247 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f00c6f-ab61-4941-b3cb-1779a64949d5 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.450359 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27329-92dd-4b3b-ae75-81c3d6e9894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.451193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27329-92dd-4b3b-ae75-81c3d6e9894f admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.451484 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27329-92dd-4b3b-ae75-81c3d6e9894f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.451912 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27329-92dd-4b3b-ae75-81c3d6e9894f admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.452891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27329-92dd-4b3b-ae75-81c3d6e9894f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.457199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27329-92dd-4b3b-ae75-81c3d6e9894f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:08.471546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1409/2793] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:08.479999 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e88173-b6a6-4430-bfa5-81138423d0af admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.491310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e88173-b6a6-4430-bfa5-81138423d0af admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.496747 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.497467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.497744 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.498029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.498797 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.500381 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:08.511767 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1385/2794] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:08.516016 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27329-92dd-4b3b-ae75-81c3d6e9894f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.526944 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27329-92dd-4b3b-ae75-81c3d6e9894f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.531492 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1cc32-1f02-46d8-baa7-ecb8b441b2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.532399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1cc32-1f02-46d8-baa7-ecb8b441b2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.532683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1cc32-1f02-46d8-baa7-ecb8b441b2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.532956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1cc32-1f02-46d8-baa7-ecb8b441b2f7 admin admin] PATH_INFO: `/v3/projects/8ab0576146234de98e379c8494c925d1/users/21b9215f80ff45f19a7b134802de8d2d/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.546054 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.547875 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:08.550865 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1cc32-1f02-46d8-baa7-ecb8b441b2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab0576146234de98e379c8494c925d1, user_id=21b9215f80ff45f19a7b134802de8d2d, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.553815 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1cc32-1f02-46d8-baa7-ecb8b441b2f7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:08.567776 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c994-bf9d-48c5-9393-d3f17725099c admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.573974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.574812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.575090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.575366 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] PATH_INFO: `/v3/projects/3862413d8ebd444986c551533ff8174e` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.576773 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3862413d8ebd444986c551533ff8174e)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.579222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:08.635995 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1410/2795] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:13:08 2022] PUT /identity/v3/projects/8ab0576146234de98e379c8494c925d1/users/21b9215f80ff45f19a7b134802de8d2d/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:08.646942 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69d7e-6379-4510-b2b1-e4408dd52dc4 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.647133 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69d7e-6379-4510-b2b1-e4408dd52dc4 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.647414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69d7e-6379-4510-b2b1-e4408dd52dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.676531 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-36a69d7e-6379-4510-b2b1-e4408dd52dc4 None None] MFA Rules not processed for user `21b9215f80ff45f19a7b134802de8d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:08.677788 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-36a69d7e-6379-4510-b2b1-e4408dd52dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:08.711119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3862413d8ebd444986c551533ff8174e', 'request_id': 'req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:08.750166 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1411/2796] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:08.755269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a69d7e-6379-4510-b2b1-e4408dd52dc4 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.806210 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3862413d8ebd444986c551533ff8174e', 'request_id': 'req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:08.817069 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3862413d8ebd444986c551533ff8174e', 'request_id': 'req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:08.828983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a69d7e-6379-4510-b2b1-e4408dd52dc4 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.836419 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] The token cache is being invalidate because project 3862413d8ebd444986c551533ff8174e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:08.837112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:08.838732 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:08.841994 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1386/2797] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:08 2022] DELETE /identity/v3/projects/3862413d8ebd444986c551533ff8174e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:08.845392 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:08.847146 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:08.895538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.896364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.896754 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.897138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.897968 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.906536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:08.942112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feaaf7-cd9c-4397-aa97-e10a9ad2d9eb admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:08.950699 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:08.951681 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:08.952145 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:08.952912 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] PATH_INFO: `/v3/users/2e38f45b4a1c4e4ea9a3797f72ba9ea0` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:08.953836 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e38f45b4a1c4e4ea9a3797f72ba9ea0)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:08.955838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:09.028441 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1412/2798] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:13:08 2022] POST /identity/v3/projects => generated 407 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:13:09.029547 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:09.031393 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:09.121570 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c21375-0009-4843-9a6b-d38fca9cc3c1 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:09.126623 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:09.127313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:09.127593 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:09.127867 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:09.128559 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:09.130529 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:09.175850 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e38f45b4a1c4e4ea9a3797f72ba9ea0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:09.191856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e38f45b4a1c4e4ea9a3797f72ba9ea0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:09.192676 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e38f45b4a1c4e4ea9a3797f72ba9ea0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:09.193308 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e38f45b4a1c4e4ea9a3797f72ba9ea0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:09.270890 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1413/2799] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:13:09 2022] POST /identity/v3/users => generated 310 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:13:09.274969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:09.279708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:09.298448 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb47a-eef3-4422-bb7e-bcb9d6c650f6 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:09.305112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6470cba-0203-421d-8086-352417cd2674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:09.305687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470cba-0203-421d-8086-352417cd2674 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:09.306152 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470cba-0203-421d-8086-352417cd2674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:09.306583 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6470cba-0203-421d-8086-352417cd2674 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:09.307336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6470cba-0203-421d-8086-352417cd2674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:09.309001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6470cba-0203-421d-8086-352417cd2674 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:09.314749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e38f45b4a1c4e4ea9a3797f72ba9ea0'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:09.333902 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1414/2800] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:13:09.337480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6470cba-0203-421d-8086-352417cd2674 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:09.342377 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1387/2801] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:08 2022] DELETE /identity/v3/users/2e38f45b4a1c4e4ea9a3797f72ba9ea0 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:13:09.352095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6470cba-0203-421d-8086-352417cd2674 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:09.438976 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0cfa9-7343-4f35-9e2c-6926cc7ccc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:09.440269 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0cfa9-7343-4f35-9e2c-6926cc7ccc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:09.441145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0cfa9-7343-4f35-9e2c-6926cc7ccc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:09.441466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0cfa9-7343-4f35-9e2c-6926cc7ccc72 admin admin] PATH_INFO: `/v3/projects/1643ad7cfb7549d192126d4d692d7da8/users/027654db5091448b8980a2062c7d4ee7/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:09.463157 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0cfa9-7343-4f35-9e2c-6926cc7ccc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1643ad7cfb7549d192126d4d692d7da8, user_id=027654db5091448b8980a2062c7d4ee7, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:09.466935 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0cfa9-7343-4f35-9e2c-6926cc7ccc72 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:09.584871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1415/2802] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:13:09 2022] PUT /identity/v3/projects/1643ad7cfb7549d192126d4d692d7da8/users/027654db5091448b8980a2062c7d4ee7/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:09.589039 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:09.601251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340fd65-0248-4ae9-84de-f3631e2aa47d admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:09.676241 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb8098-e029-4b5d-8520-33e1e7cf62b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:09.677015 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb8098-e029-4b5d-8520-33e1e7cf62b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:09.677401 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb8098-e029-4b5d-8520-33e1e7cf62b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:09.677745 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb8098-e029-4b5d-8520-33e1e7cf62b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:09.678566 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb8098-e029-4b5d-8520-33e1e7cf62b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:09.680333 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb8098-e029-4b5d-8520-33e1e7cf62b2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:09.692425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1388/2803] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:09.696786 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0cfa9-7343-4f35-9e2c-6926cc7ccc72 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:09.707909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0cfa9-7343-4f35-9e2c-6926cc7ccc72 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:09.734412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:09.734412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:09.734412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:09.734412 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] PATH_INFO: `/v3/projects/1643ad7cfb7549d192126d4d692d7da8/users/027654db5091448b8980a2062c7d4ee7/roles/f1d6bdc882c24a2a9389961135865317` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:09.735048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1643ad7cfb7549d192126d4d692d7da8, user_id=027654db5091448b8980a2062c7d4ee7, role_id=f1d6bdc882c24a2a9389961135865317)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:09.735048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:09.735048 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1416/2804] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:13:09 2022] PUT /identity/v3/projects/1643ad7cfb7549d192126d4d692d7da8/users/027654db5091448b8980a2062c7d4ee7/roles/f1d6bdc882c24a2a9389961135865317 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:09.743545 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f665e3-643a-45c6-bb5a-f376dc1bc150 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:09.743880 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f665e3-643a-45c6-bb5a-f376dc1bc150 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:09.744185 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f665e3-643a-45c6-bb5a-f376dc1bc150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:09.813598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-18f665e3-643a-45c6-bb5a-f376dc1bc150 None None] MFA Rules not processed for user `027654db5091448b8980a2062c7d4ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:09.813598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-18f665e3-643a-45c6-bb5a-f376dc1bc150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:09.843093 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1389/2805] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:09 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:09.854657 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:09.856432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:09.919146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dbc31-4c6b-4d79-82d4-81bb4202b89f admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:09.922364 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f665e3-643a-45c6-bb5a-f376dc1bc150 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:09.923350 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861407e-96e0-43c0-9d22-0945fe05e492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:09.923955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-18f665e3-643a-45c6-bb5a-f376dc1bc150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:09.924382 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861407e-96e0-43c0-9d22-0945fe05e492 service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:09.924766 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861407e-96e0-43c0-9d22-0945fe05e492 service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:09.925179 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861407e-96e0-43c0-9d22-0945fe05e492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:09.935280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861407e-96e0-43c0-9d22-0945fe05e492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:09.937073 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861407e-96e0-43c0-9d22-0945fe05e492 service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:09.949005 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1417/2806] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:09 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:10.005199 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f665e3-643a-45c6-bb5a-f376dc1bc150 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:10.011746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:10.012811 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.013279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.013735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] PATH_INFO: `/v3/projects/3cf5c0ea7cc24939940717bebd235d02` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.015266 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf5c0ea7cc24939940717bebd235d02)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:10.017169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:10.155735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf5c0ea7cc24939940717bebd235d02', 'request_id': 'req-50b91a55-b28f-4482-accf-d2110da0d0a9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:10.234493 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf5c0ea7cc24939940717bebd235d02', 'request_id': 'req-50b91a55-b28f-4482-accf-d2110da0d0a9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:10.240312 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf5c0ea7cc24939940717bebd235d02', 'request_id': 'req-50b91a55-b28f-4482-accf-d2110da0d0a9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:10.251198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] The token cache is being invalidate because project 3cf5c0ea7cc24939940717bebd235d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:10.251486 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:10.252134 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:10.253783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1390/2807] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:09 2022] DELETE /identity/v3/projects/3cf5c0ea7cc24939940717bebd235d02 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:10.259194 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f624a-d0c0-446f-b524-4495716e6936 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.259732 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f624a-d0c0-446f-b524-4495716e6936 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.260287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f624a-d0c0-446f-b524-4495716e6936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.279019 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-6e7f624a-d0c0-446f-b524-4495716e6936 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:10.280214 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-6e7f624a-d0c0-446f-b524-4495716e6936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:10.339150 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1418/2808] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:10.344561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:10.346023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:10.404701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71670445-be8e-42f8-b525-c98892c2c4ee None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.404979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71670445-be8e-42f8-b525-c98892c2c4ee None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.405288 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71670445-be8e-42f8-b525-c98892c2c4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.412749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b91a55-b28f-4482-accf-d2110da0d0a9 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:10.418803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:10.423393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.423393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.423393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.423393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:10.426227 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-71670445-be8e-42f8-b525-c98892c2c4ee None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:10.427339 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-71670445-be8e-42f8-b525-c98892c2c4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:10.435518 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1419/2809] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:13:10.439911 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71670445-be8e-42f8-b525-c98892c2c4ee None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:10.449587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71670445-be8e-42f8-b525-c98892c2c4ee None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:10.454351 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:10.455004 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.455291 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.455568 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.456295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:13:10.456604 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:10.458258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:10.474690 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1420/2810] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:13:10.475824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:10.485152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:10.486651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ea669-e038-49fa-8f23-eaf250ceb4bc admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:10.486934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:10.491419 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cf9f1-f88e-4dde-b16a-4af4757b717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:10.492089 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf9f1-f88e-4dde-b16a-4af4757b717c admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.492375 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf9f1-f88e-4dde-b16a-4af4757b717c admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.492649 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf9f1-f88e-4dde-b16a-4af4757b717c admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.493372 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cf9f1-f88e-4dde-b16a-4af4757b717c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:10.495994 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cf9f1-f88e-4dde-b16a-4af4757b717c admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:10.497202 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1391/2811] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:10 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:10.615810 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1421/2812] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:13:10 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:13:10.624174 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:10.635330 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72a173-1f7d-4223-bf6a-247c5730641d service cinder] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:10.694752 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60759e-c93b-4ef2-934b-8a5096c8c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:10.696424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60759e-c93b-4ef2-934b-8a5096c8c9bf admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.696424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60759e-c93b-4ef2-934b-8a5096c8c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.696424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60759e-c93b-4ef2-934b-8a5096c8c9bf admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.697669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60759e-c93b-4ef2-934b-8a5096c8c9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:10.701227 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60759e-c93b-4ef2-934b-8a5096c8c9bf admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:10.846654 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1392/2813] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:13:10 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:13:10.850921 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cf9f1-f88e-4dde-b16a-4af4757b717c admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:10.861272 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cf9f1-f88e-4dde-b16a-4af4757b717c admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:10.865997 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6484e-d121-4243-afef-3a55213079c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:10.866831 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6484e-d121-4243-afef-3a55213079c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.867193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6484e-d121-4243-afef-3a55213079c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.867540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6484e-d121-4243-afef-3a55213079c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.868332 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6484e-d121-4243-afef-3a55213079c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:10.870127 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6484e-d121-4243-afef-3a55213079c9 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:10.880385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1422/2814] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:10.885026 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60759e-c93b-4ef2-934b-8a5096c8c9bf admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:10.896028 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60759e-c93b-4ef2-934b-8a5096c8c9bf admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:10.901575 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16b42e-4d26-4145-ba10-509d6ce610a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:10.908078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b42e-4d26-4145-ba10-509d6ce610a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.908078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b42e-4d26-4145-ba10-509d6ce610a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.908078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16b42e-4d26-4145-ba10-509d6ce610a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.908078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16b42e-4d26-4145-ba10-509d6ce610a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:10.908078 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16b42e-4d26-4145-ba10-509d6ce610a9 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:10.915496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1393/2815] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:10.920904 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6484e-d121-4243-afef-3a55213079c9 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:10.931232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6484e-d121-4243-afef-3a55213079c9 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:10.936602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:10.937591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:10.937871 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:10.938145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] PATH_INFO: `/v3/projects/5a2283d22b524c5ca4fe6f6d33dfe7ae/users/3d6c93c18e154a14abe806525e8218b1/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:10.956525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2283d22b524c5ca4fe6f6d33dfe7ae, user_id=3d6c93c18e154a14abe806525e8218b1, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:10.956525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:11.092090 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1423/2816] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:13:10 2022] PUT /identity/v3/projects/5a2283d22b524c5ca4fe6f6d33dfe7ae/users/3d6c93c18e154a14abe806525e8218b1/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:11.102462 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2696428-209f-47e0-88e9-96204abdf864 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:11.102755 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2696428-209f-47e0-88e9-96204abdf864 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:11.103038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2696428-209f-47e0-88e9-96204abdf864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:11.132590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-e2696428-209f-47e0-88e9-96204abdf864 None None] MFA Rules not processed for user `3d6c93c18e154a14abe806525e8218b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:11.133827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e2696428-209f-47e0-88e9-96204abdf864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:11.217279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1394/2817] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:11.226368 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:11.229634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:11.308218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800daf1-b5d4-4c4c-b7e5-ff4e639f7688 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:11.312142 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61e020-a948-402e-b925-f5fa5612ff75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d96159b7fb49c08b1f5c014d26f79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:11.312795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61e020-a948-402e-b925-f5fa5612ff75 service glance] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:11.313678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61e020-a948-402e-b925-f5fa5612ff75 service glance] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:11.313678 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61e020-a948-402e-b925-f5fa5612ff75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:11.322665 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61e020-a948-402e-b925-f5fa5612ff75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:11.324137 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61e020-a948-402e-b925-f5fa5612ff75 service glance] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:11.333679 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1424/2818] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:20.813852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2696428-209f-47e0-88e9-96204abdf864 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:20.815305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e2696428-209f-47e0-88e9-96204abdf864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:20.885378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2696428-209f-47e0-88e9-96204abdf864 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:20.890037 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:20.890904 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:20.891261 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:20.891542 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] PATH_INFO: `/v3/users/21b9215f80ff45f19a7b134802de8d2d` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:20.892905 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b9215f80ff45f19a7b134802de8d2d)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:20.895115 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:21.134348 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b9215f80ff45f19a7b134802de8d2d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:21.146316 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b9215f80ff45f19a7b134802de8d2d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:21.147020 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b9215f80ff45f19a7b134802de8d2d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:21.147669 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b9215f80ff45f19a7b134802de8d2d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:21.223296 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b9215f80ff45f19a7b134802de8d2d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:21.236673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1395/2819] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:20 2022] DELETE /identity/v3/users/21b9215f80ff45f19a7b134802de8d2d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:21.241411 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa08e8-a056-470b-bb14-ae2da1f0ee80 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:21.244474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa08e8-a056-470b-bb14-ae2da1f0ee80 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:21.244474 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa08e8-a056-470b-bb14-ae2da1f0ee80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:21.261387 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-aefa08e8-a056-470b-bb14-ae2da1f0ee80 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:21.262587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-aefa08e8-a056-470b-bb14-ae2da1f0ee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:21.326130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1425/2820] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:13:21.336967 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:21.339783 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:21.398852 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b6e6-29ff-4837-8028-adcc00d3f46e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:21.403660 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72995356-84cc-4ad4-88ef-a06ae97d2aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:21.404310 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72995356-84cc-4ad4-88ef-a06ae97d2aff service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:21.404595 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72995356-84cc-4ad4-88ef-a06ae97d2aff service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:21.404870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72995356-84cc-4ad4-88ef-a06ae97d2aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:21.413948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72995356-84cc-4ad4-88ef-a06ae97d2aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:21.415412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72995356-84cc-4ad4-88ef-a06ae97d2aff service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:21.426343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1396/2821] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:21.866256 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa08e8-a056-470b-bb14-ae2da1f0ee80 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:21.868134 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-aefa08e8-a056-470b-bb14-ae2da1f0ee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:21.882138 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa08e8-a056-470b-bb14-ae2da1f0ee80 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:21.887335 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:21.888148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:21.888430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:21.888711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] PATH_INFO: `/v3/projects/8ab0576146234de98e379c8494c925d1` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:21.890203 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab0576146234de98e379c8494c925d1)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:21.892232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:22.035076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab0576146234de98e379c8494c925d1', 'request_id': 'req-5adf9f8c-323f-493b-9e13-49ed13f82a73'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.102825 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab0576146234de98e379c8494c925d1', 'request_id': 'req-5adf9f8c-323f-493b-9e13-49ed13f82a73'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.108920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab0576146234de98e379c8494c925d1', 'request_id': 'req-5adf9f8c-323f-493b-9e13-49ed13f82a73'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.120725 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] The token cache is being invalidate because project 8ab0576146234de98e379c8494c925d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:22.121012 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.121711 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.123274 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1426/2822] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:21 2022] DELETE /identity/v3/projects/8ab0576146234de98e379c8494c925d1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:22.127280 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72995356-84cc-4ad4-88ef-a06ae97d2aff service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:22.138309 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72995356-84cc-4ad4-88ef-a06ae97d2aff service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:22.198119 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:22.199059 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:22.199349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:22.199634 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] PATH_INFO: `/v3/users/027654db5091448b8980a2062c7d4ee7` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:22.200856 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] RBAC: Authorizing `identity:delete_user(user_id=027654db5091448b8980a2062c7d4ee7)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:22.202821 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:22.420838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027654db5091448b8980a2062c7d4ee7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.434014 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027654db5091448b8980a2062c7d4ee7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.434817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027654db5091448b8980a2062c7d4ee7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.435428 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027654db5091448b8980a2062c7d4ee7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.508623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-d9ada8fe-2fde-4110-b22f-0dad057a049e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027654db5091448b8980a2062c7d4ee7'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:22.523190 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1397/2823] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:22 2022] DELETE /identity/v3/users/027654db5091448b8980a2062c7d4ee7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:13:22.979059 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:22.980614 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:22.995832 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf9f8c-323f-493b-9e13-49ed13f82a73 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:23.055927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:23.057356 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.057643 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.057918 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] PATH_INFO: `/v3/projects/1643ad7cfb7549d192126d4d692d7da8` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.059123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1643ad7cfb7549d192126d4d692d7da8)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:23.061251 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:23.178082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1643ad7cfb7549d192126d4d692d7da8', 'request_id': 'req-7924ae8a-378c-42e7-9552-080b226ad6f7'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:23.263154 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1643ad7cfb7549d192126d4d692d7da8', 'request_id': 'req-7924ae8a-378c-42e7-9552-080b226ad6f7'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:23.269540 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1643ad7cfb7549d192126d4d692d7da8', 'request_id': 'req-7924ae8a-378c-42e7-9552-080b226ad6f7'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:23.281404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] The token cache is being invalidate because project 1643ad7cfb7549d192126d4d692d7da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:23.281714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:23.282560 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-7924ae8a-378c-42e7-9552-080b226ad6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:23.284337 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1427/2824] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:22 2022] DELETE /identity/v3/projects/1643ad7cfb7549d192126d4d692d7da8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:23.289436 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d95228-93db-4753-812d-5a3be0bca5fd None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.297685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d95228-93db-4753-812d-5a3be0bca5fd None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.297685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d95228-93db-4753-812d-5a3be0bca5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.308349 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-20d95228-93db-4753-812d-5a3be0bca5fd None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:23.309707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-20d95228-93db-4753-812d-5a3be0bca5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:23.368800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1398/2825] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:23.433404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68703-d318-4df4-bb30-622504450e2e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.433686 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68703-d318-4df4-bb30-622504450e2e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.433965 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68703-d318-4df4-bb30-622504450e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.454104 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c8d68703-d318-4df4-bb30-622504450e2e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:23.455421 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c8d68703-d318-4df4-bb30-622504450e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:23.464764 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1428/2826] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:23.469178 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d95228-93db-4753-812d-5a3be0bca5fd None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:23.478863 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d95228-93db-4753-812d-5a3be0bca5fd None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:23.483673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:23.484327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.484615 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.484891 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.485662 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:13:23.486013 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:23.487605 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:23.499038 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1399/2827] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 14:13:23.503705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d68703-d318-4df4-bb30-622504450e2e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:23.515271 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d68703-d318-4df4-bb30-622504450e2e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:23.520241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ad32-3ce7-406f-9dd4-28f1c316cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:23.520905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ad32-3ce7-406f-9dd4-28f1c316cf62 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.521190 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ad32-3ce7-406f-9dd4-28f1c316cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.521504 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ad32-3ce7-406f-9dd4-28f1c316cf62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.522208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1ad32-3ce7-406f-9dd4-28f1c316cf62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:23.524146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1ad32-3ce7-406f-9dd4-28f1c316cf62 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:23.601408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1429/2828] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:13:23 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:13:23.605870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:23.615844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912179c-0a0f-4db5-8ec4-0fd13bdaf58e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:23.675838 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721f29d-14fa-40e4-bc97-a22ed0425529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:23.676510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f29d-14fa-40e4-bc97-a22ed0425529 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.676794 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f29d-14fa-40e4-bc97-a22ed0425529 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.677073 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f29d-14fa-40e4-bc97-a22ed0425529 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.677812 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721f29d-14fa-40e4-bc97-a22ed0425529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:23.679814 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721f29d-14fa-40e4-bc97-a22ed0425529 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:23.760746 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1400/2829] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:13:23 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:13:23.765032 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ad32-3ce7-406f-9dd4-28f1c316cf62 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:23.776095 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ad32-3ce7-406f-9dd4-28f1c316cf62 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:23.780847 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be05b9-3a8c-43be-8d4f-f90d99b51294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:23.781571 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be05b9-3a8c-43be-8d4f-f90d99b51294 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.781858 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be05b9-3a8c-43be-8d4f-f90d99b51294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.785336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be05b9-3a8c-43be-8d4f-f90d99b51294 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.785336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be05b9-3a8c-43be-8d4f-f90d99b51294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:23.785336 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be05b9-3a8c-43be-8d4f-f90d99b51294 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:23.796430 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1430/2830] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:23.801042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721f29d-14fa-40e4-bc97-a22ed0425529 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:23.811215 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721f29d-14fa-40e4-bc97-a22ed0425529 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:23.815992 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e273c2-9f85-4971-80cb-822984e48e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:23.816649 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e273c2-9f85-4971-80cb-822984e48e3e admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.816935 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e273c2-9f85-4971-80cb-822984e48e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.817214 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e273c2-9f85-4971-80cb-822984e48e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.817975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e273c2-9f85-4971-80cb-822984e48e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:23.819592 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e273c2-9f85-4971-80cb-822984e48e3e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:23.831942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1401/2831] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:13:23.835146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be05b9-3a8c-43be-8d4f-f90d99b51294 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:23.845429 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be05b9-3a8c-43be-8d4f-f90d99b51294 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:23.849969 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:23.850868 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.851200 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.851444 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] PATH_INFO: `/v3/projects/a1aeaca1127949749c38920013549eda/users/6e5a5eb652154b11b04755524ba861c2/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.866591 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1aeaca1127949749c38920013549eda, user_id=6e5a5eb652154b11b04755524ba861c2, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:23.872829 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:23.953517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1431/2832] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:13:23 2022] PUT /identity/v3/projects/a1aeaca1127949749c38920013549eda/users/6e5a5eb652154b11b04755524ba861c2/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:23.960437 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892ad0-bd91-4493-b263-e4a30bb5f0a3 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:23.960726 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892ad0-bd91-4493-b263-e4a30bb5f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:23.961005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23892ad0-bd91-4493-b263-e4a30bb5f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:23.987506 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-23892ad0-bd91-4493-b263-e4a30bb5f0a3 None None] MFA Rules not processed for user `6e5a5eb652154b11b04755524ba861c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:23.988692 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-23892ad0-bd91-4493-b263-e4a30bb5f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:24.052775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1402/2833] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:24.066092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:24.068024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:24.123603 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53003ddf-7761-453f-8f2a-3d0cf343582e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:24.127302 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:24.127948 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:24.128232 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:24.128512 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:24.137289 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:24.138748 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:24.147409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1432/2834] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:24.868598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42077db8-e5f5-4885-aa10-b646334715da None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:24.869193 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42077db8-e5f5-4885-aa10-b646334715da None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:24.869423 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42077db8-e5f5-4885-aa10-b646334715da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:24.888294 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-42077db8-e5f5-4885-aa10-b646334715da None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:24.901819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-42077db8-e5f5-4885-aa10-b646334715da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:24.949694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1403/2835] 10.222.0.69 () {58 vars in 1009 bytes} [Wed May 4 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:25.007011 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:25.008416 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:25.084092 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a561c-f8a4-4b94-8ced-299644f1343c service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:25.090155 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4cb85-3603-49a8-bb61-a23b2c2b0524 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:25.090361 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cb85-3603-49a8-bb61-a23b2c2b0524 service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:25.090466 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cb85-3603-49a8-bb61-a23b2c2b0524 service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:25.090736 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cb85-3603-49a8-bb61-a23b2c2b0524 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:25.099692 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4cb85-3603-49a8-bb61-a23b2c2b0524 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:25.101333 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4cb85-3603-49a8-bb61-a23b2c2b0524 service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:25.110805 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1433/2836] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:13:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 14:13:27.602590 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42077db8-e5f5-4885-aa10-b646334715da None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:27.681637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42077db8-e5f5-4885-aa10-b646334715da None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:27.686623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:27.687853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:27.688225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:27.688730 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] PATH_INFO: `/v3/users/6e5a5eb652154b11b04755524ba861c2` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:27.690057 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5a5eb652154b11b04755524ba861c2)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:27.692239 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:27.899893 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5a5eb652154b11b04755524ba861c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:27.922945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5a5eb652154b11b04755524ba861c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:27.923731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5a5eb652154b11b04755524ba861c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:27.924346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5a5eb652154b11b04755524ba861c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:28.039295 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5a5eb652154b11b04755524ba861c2'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:28.054775 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1404/2837] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:27 2022] DELETE /identity/v3/users/6e5a5eb652154b11b04755524ba861c2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:28.060563 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda796-2d86-430a-815f-50acf73af91e None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:28.061199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda796-2d86-430a-815f-50acf73af91e None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:28.061199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda796-2d86-430a-815f-50acf73af91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:28.079386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-a2bda796-2d86-430a-815f-50acf73af91e None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:28.080575 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a2bda796-2d86-430a-815f-50acf73af91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:28.149592 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1434/2838] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:28.160855 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:28.163362 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:28.228259 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8df5c-4ff8-4f0e-951b-53c0bc611aa7 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:28.234287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:28.235323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:28.235617 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:28.235895 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:28.247168 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:28.248835 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:28.267322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1405/2839] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:28.770425 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bda796-2d86-430a-815f-50acf73af91e None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:28.772477 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-a2bda796-2d86-430a-815f-50acf73af91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:28.790323 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bda796-2d86-430a-815f-50acf73af91e None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:28.799343 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:28.800651 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:28.800937 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:28.802038 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] PATH_INFO: `/v3/projects/a1aeaca1127949749c38920013549eda` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:28.804043 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1aeaca1127949749c38920013549eda)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:28.807703 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:28.925388 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1aeaca1127949749c38920013549eda', 'request_id': 'req-818879eb-59bc-48c0-8884-199dd4979ce5'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:29.005933 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1aeaca1127949749c38920013549eda', 'request_id': 'req-818879eb-59bc-48c0-8884-199dd4979ce5'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:29.015319 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1aeaca1127949749c38920013549eda', 'request_id': 'req-818879eb-59bc-48c0-8884-199dd4979ce5'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:29.031927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] The token cache is being invalidate because project a1aeaca1127949749c38920013549eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:29.031927 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:29.032597 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-818879eb-59bc-48c0-8884-199dd4979ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:29.034639 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1435/2840] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:28 2022] DELETE /identity/v3/projects/a1aeaca1127949749c38920013549eda => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:43.689180 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:43.690641 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:43.704152 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a63d31-5d08-407d-9b4e-3956108c0040 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:43.761378 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:43.762256 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:43.762539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:43.762810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] PATH_INFO: `/v3/users/3d6c93c18e154a14abe806525e8218b1` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:43.764023 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6c93c18e154a14abe806525e8218b1)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:43.765972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:43.985465 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6c93c18e154a14abe806525e8218b1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:43.997005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6c93c18e154a14abe806525e8218b1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:43.997706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6c93c18e154a14abe806525e8218b1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:43.998376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6c93c18e154a14abe806525e8218b1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:44.084760 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6c93c18e154a14abe806525e8218b1'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:44.097970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1406/2841] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:43 2022] DELETE /identity/v3/users/3d6c93c18e154a14abe806525e8218b1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:44.102564 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2c71-dbe2-4cb6-8202-1fbb4c996639 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:44.103699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2c71-dbe2-4cb6-8202-1fbb4c996639 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:44.103699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2c71-dbe2-4cb6-8202-1fbb4c996639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:44.121261 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-f12f2c71-dbe2-4cb6-8202-1fbb4c996639 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:44.122480 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f12f2c71-dbe2-4cb6-8202-1fbb4c996639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:44.180208 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1436/2842] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:44.190635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:44.192070 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:44.251047 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10665f-3c06-4a60-bffa-50a60945e2de admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:44.254527 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e0c8-e0d5-4af7-9492-32a78badd8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:44.255169 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e0c8-e0d5-4af7-9492-32a78badd8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:44.255448 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e0c8-e0d5-4af7-9492-32a78badd8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:44.255721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e0c8-e0d5-4af7-9492-32a78badd8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:44.265305 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276e0c8-e0d5-4af7-9492-32a78badd8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:44.266735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276e0c8-e0d5-4af7-9492-32a78badd8c3 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:44.276706 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1407/2843] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:44.745308 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f2c71-dbe2-4cb6-8202-1fbb4c996639 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:44.747457 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f12f2c71-dbe2-4cb6-8202-1fbb4c996639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:44.762270 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f2c71-dbe2-4cb6-8202-1fbb4c996639 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:44.767042 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:44.767899 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:44.768183 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:44.768458 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] PATH_INFO: `/v3/projects/5a2283d22b524c5ca4fe6f6d33dfe7ae` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:44.769971 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2283d22b524c5ca4fe6f6d33dfe7ae)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:44.774389 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:44.824790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950339bd-1808-4a9b-8a95-65662b0eea30 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:44.829586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950339bd-1808-4a9b-8a95-65662b0eea30 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:44.829586 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950339bd-1808-4a9b-8a95-65662b0eea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:44.843742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-950339bd-1808-4a9b-8a95-65662b0eea30 None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:44.844946 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-950339bd-1808-4a9b-8a95-65662b0eea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:44.903800 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1408/2844] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:13:44.909027 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2283d22b524c5ca4fe6f6d33dfe7ae', 'request_id': 'req-72f78a4c-b723-4720-974b-83ae7ce4517e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:44.919701 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950339bd-1808-4a9b-8a95-65662b0eea30 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:44.921112 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-950339bd-1808-4a9b-8a95-65662b0eea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:44.990721 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950339bd-1808-4a9b-8a95-65662b0eea30 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:44.993606 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2283d22b524c5ca4fe6f6d33dfe7ae', 'request_id': 'req-72f78a4c-b723-4720-974b-83ae7ce4517e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:44.999782 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2283d22b524c5ca4fe6f6d33dfe7ae', 'request_id': 'req-72f78a4c-b723-4720-974b-83ae7ce4517e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:45.011572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] The token cache is being invalidate because project 5a2283d22b524c5ca4fe6f6d33dfe7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:45.011930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:45.012491 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-72f78a4c-b723-4720-974b-83ae7ce4517e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:45.014123 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1437/2845] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:44 2022] DELETE /identity/v3/projects/5a2283d22b524c5ca4fe6f6d33dfe7ae => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:45.019920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716d696-31b8-4dcb-ad23-a2db7126d81b None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.020218 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716d696-31b8-4dcb-ad23-a2db7126d81b None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.020502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716d696-31b8-4dcb-ad23-a2db7126d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.041278 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-1716d696-31b8-4dcb-ad23-a2db7126d81b None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:45.042655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-1716d696-31b8-4dcb-ad23-a2db7126d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:45.053344 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:45.054124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.054411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.054707 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.057164 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:45.105641 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1438/2846] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:13:45.114363 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ac0f-81b2-4195-8b76-2a3a3db0aa21 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.114660 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ac0f-81b2-4195-8b76-2a3a3db0aa21 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.114953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ac0f-81b2-4195-8b76-2a3a3db0aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.117438 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:45.120052 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:45.128673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1409/2847] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:13:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:13:45.134594 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-c308ac0f-81b2-4195-8b76-2a3a3db0aa21 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:45.136071 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-c308ac0f-81b2-4195-8b76-2a3a3db0aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:45.144231 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1439/2848] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:13:45.148400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:45.159100 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f791be-ed56-411e-9481-006efb8effa7 service swift] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:45.163941 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:45.164585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.164866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.165808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.166771 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:13:45.167079 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:45.168689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:45.180279 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1410/2849] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:13:45.185625 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ac0f-81b2-4195-8b76-2a3a3db0aa21 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:45.194869 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ac0f-81b2-4195-8b76-2a3a3db0aa21 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:45.199980 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f57a9-a45d-4cd6-bbdc-f47c7ef11156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:45.200705 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f57a9-a45d-4cd6-bbdc-f47c7ef11156 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.200989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f57a9-a45d-4cd6-bbdc-f47c7ef11156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.201299 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f57a9-a45d-4cd6-bbdc-f47c7ef11156 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.201992 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f57a9-a45d-4cd6-bbdc-f47c7ef11156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:45.203982 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f57a9-a45d-4cd6-bbdc-f47c7ef11156 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:45.305567 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1440/2850] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:13:45 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:13:45.310957 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:45.321255 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17ecf5-30ec-42d2-8a53-73529976d22e admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:45.379412 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f75ae-ea99-47fc-bdea-0a39e99366ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:45.380080 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f75ae-ea99-47fc-bdea-0a39e99366ae admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.380360 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f75ae-ea99-47fc-bdea-0a39e99366ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.380735 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f75ae-ea99-47fc-bdea-0a39e99366ae admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.381500 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f75ae-ea99-47fc-bdea-0a39e99366ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:45.383410 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f75ae-ea99-47fc-bdea-0a39e99366ae admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:45.474222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1411/2851] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:13:45 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:13:45.479112 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f57a9-a45d-4cd6-bbdc-f47c7ef11156 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:45.489405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f57a9-a45d-4cd6-bbdc-f47c7ef11156 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:45.495035 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac815b9-b264-4a2b-ab58-bfb76d3c7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:45.495842 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac815b9-b264-4a2b-ab58-bfb76d3c7c33 admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.496131 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac815b9-b264-4a2b-ab58-bfb76d3c7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.496414 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac815b9-b264-4a2b-ab58-bfb76d3c7c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.497148 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac815b9-b264-4a2b-ab58-bfb76d3c7c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:45.498795 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac815b9-b264-4a2b-ab58-bfb76d3c7c33 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:45.510599 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1441/2852] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:45.514679 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f75ae-ea99-47fc-bdea-0a39e99366ae admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:45.524853 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f75ae-ea99-47fc-bdea-0a39e99366ae admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:45.529689 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb75e50-75b2-418f-9fac-bf94bf2f6d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:45.530461 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75e50-75b2-418f-9fac-bf94bf2f6d8d admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.530694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75e50-75b2-418f-9fac-bf94bf2f6d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.530974 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75e50-75b2-418f-9fac-bf94bf2f6d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.531714 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb75e50-75b2-418f-9fac-bf94bf2f6d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:45.533434 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb75e50-75b2-418f-9fac-bf94bf2f6d8d admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:45.545864 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1412/2853] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:45.550409 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac815b9-b264-4a2b-ab58-bfb76d3c7c33 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:45.561534 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac815b9-b264-4a2b-ab58-bfb76d3c7c33 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:45.566284 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:45.567186 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.567502 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.567784 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] PATH_INFO: `/v3/projects/0a98baf533d141d5b8e7716a77fc8b04/users/e303f04aa824459fa119003dd6ccdc33/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.583482 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a98baf533d141d5b8e7716a77fc8b04, user_id=e303f04aa824459fa119003dd6ccdc33, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:45.586146 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:45.663075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1442/2854] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:13:45 2022] PUT /identity/v3/projects/0a98baf533d141d5b8e7716a77fc8b04/users/e303f04aa824459fa119003dd6ccdc33/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:13:45.674393 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475015c-4f10-4a4e-905b-b65a255337aa None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.674687 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475015c-4f10-4a4e-905b-b65a255337aa None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.674972 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475015c-4f10-4a4e-905b-b65a255337aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.703201 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-0475015c-4f10-4a4e-905b-b65a255337aa None None] MFA Rules not processed for user `e303f04aa824459fa119003dd6ccdc33`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:45.704424 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0475015c-4f10-4a4e-905b-b65a255337aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:45.771539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1413/2855] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:45.786233 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:45.786233 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:45.842602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c914f-5998-4bae-a37c-b2e3d075568e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:45.846473 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf2111-ff1a-4934-b191-a6116540115d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:45.847120 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2111-ff1a-4934-b191-a6116540115d service cinder] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:45.847537 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2111-ff1a-4934-b191-a6116540115d service cinder] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:45.847668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2111-ff1a-4934-b191-a6116540115d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:45.858088 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf2111-ff1a-4934-b191-a6116540115d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:45.859446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf2111-ff1a-4934-b191-a6116540115d service cinder] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:45.869645 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1443/2856] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:48.459036 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475015c-4f10-4a4e-905b-b65a255337aa None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:48.460704 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-0475015c-4f10-4a4e-905b-b65a255337aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:48.541948 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475015c-4f10-4a4e-905b-b65a255337aa None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:48.546870 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:48.548561 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:48.548849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:48.549121 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] PATH_INFO: `/v3/users/a41697666e4d41b8a362d18e539facd9` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:48.550405 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41697666e4d41b8a362d18e539facd9)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:48.552551 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:48.798601 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41697666e4d41b8a362d18e539facd9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:48.814258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41697666e4d41b8a362d18e539facd9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:48.814258 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41697666e4d41b8a362d18e539facd9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:48.815578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41697666e4d41b8a362d18e539facd9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:48.937053 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-533cfcb6-4f3a-451a-86c1-1b6a9d73ea77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41697666e4d41b8a362d18e539facd9'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:48.952109 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1414/2857] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:48 2022] DELETE /identity/v3/users/a41697666e4d41b8a362d18e539facd9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:13:49.223729 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf2111-ff1a-4934-b191-a6116540115d service cinder] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:49.236804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf2111-ff1a-4934-b191-a6116540115d service cinder] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:49.296803 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:49.297701 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:49.297983 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:49.298257 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] PATH_INFO: `/v3/projects/2fbc65e323204179bedb61d709caed21` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:49.299472 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbc65e323204179bedb61d709caed21)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:49.301399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:49.476082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbc65e323204179bedb61d709caed21', 'request_id': 'req-3bdb1178-1d31-4c29-94dd-67c81cebd63b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:49.570928 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbc65e323204179bedb61d709caed21', 'request_id': 'req-3bdb1178-1d31-4c29-94dd-67c81cebd63b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:49.577481 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbc65e323204179bedb61d709caed21', 'request_id': 'req-3bdb1178-1d31-4c29-94dd-67c81cebd63b'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:49.589581 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] The token cache is being invalidate because project 2fbc65e323204179bedb61d709caed21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:49.589877 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:49.590527 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-3bdb1178-1d31-4c29-94dd-67c81cebd63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:49.592287 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1444/2858] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:49 2022] DELETE /identity/v3/projects/2fbc65e323204179bedb61d709caed21 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:49.597090 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8ffd-12e5-4dc8-ad43-1c8f15aa0c75 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:49.597608 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8ffd-12e5-4dc8-ad43-1c8f15aa0c75 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:49.597816 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c8ffd-12e5-4dc8-ad43-1c8f15aa0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:49.616387 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-bc3c8ffd-12e5-4dc8-ad43-1c8f15aa0c75 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:49.617635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bc3c8ffd-12e5-4dc8-ad43-1c8f15aa0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:49.681578 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1415/2859] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:49.743017 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77798158-1fea-43bc-ab71-e823574f20af None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:49.743326 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77798158-1fea-43bc-ab71-e823574f20af None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:49.743683 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77798158-1fea-43bc-ab71-e823574f20af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:49.764385 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-77798158-1fea-43bc-ab71-e823574f20af None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:49.765644 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-77798158-1fea-43bc-ab71-e823574f20af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:49.773905 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1445/2860] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:49.778848 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c8ffd-12e5-4dc8-ad43-1c8f15aa0c75 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:49.788694 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c8ffd-12e5-4dc8-ad43-1c8f15aa0c75 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:49.793731 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:49.794391 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:49.794673 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:49.794951 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:49.795688 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:13:49.796025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:49.797693 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:49.810025 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1416/2861] 10.222.0.69 () {58 vars in 1152 bytes} [Wed May 4 14:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:13:49.819182 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77798158-1fea-43bc-ab71-e823574f20af None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:49.828989 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77798158-1fea-43bc-ab71-e823574f20af None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:49.833730 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd53b26-36df-44fc-b30f-fdf2dc31fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:49.834386 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53b26-36df-44fc-b30f-fdf2dc31fc02 admin admin] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:49.834672 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53b26-36df-44fc-b30f-fdf2dc31fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:49.834953 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53b26-36df-44fc-b30f-fdf2dc31fc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:49.835647 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd53b26-36df-44fc-b30f-fdf2dc31fc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:49.838366 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd53b26-36df-44fc-b30f-fdf2dc31fc02 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:49.950824 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1446/2862] 10.222.0.69 () {60 vars in 1152 bytes} [Wed May 4 14:13:49 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:13:49.955158 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:49.965849 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b221fc-de4c-4d6d-9bf8-c8478d699ca5 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:50.025098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9aa84-aab0-4935-9bb3-4dee985cd346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:50.025756 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9aa84-aab0-4935-9bb3-4dee985cd346 admin admin] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:50.026042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9aa84-aab0-4935-9bb3-4dee985cd346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:50.026325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9aa84-aab0-4935-9bb3-4dee985cd346 admin admin] PATH_INFO: `/v3/users` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:50.027019 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9aa84-aab0-4935-9bb3-4dee985cd346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:50.028942 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9aa84-aab0-4935-9bb3-4dee985cd346 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:50.143343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1417/2863] 10.222.0.69 () {60 vars in 1143 bytes} [Wed May 4 14:13:49 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:13:50.153404 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd53b26-36df-44fc-b30f-fdf2dc31fc02 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:50.163802 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd53b26-36df-44fc-b30f-fdf2dc31fc02 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:50.168710 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a21d-7a16-447a-b3ae-d545663990be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:50.169438 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a21d-7a16-447a-b3ae-d545663990be admin admin] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:50.169896 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a21d-7a16-447a-b3ae-d545663990be admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:50.170204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a21d-7a16-447a-b3ae-d545663990be admin admin] PATH_INFO: `/v3/roles` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:50.170967 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78a21d-7a16-447a-b3ae-d545663990be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:50.172610 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78a21d-7a16-447a-b3ae-d545663990be admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:50.184204 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1447/2864] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:50.188671 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9aa84-aab0-4935-9bb3-4dee985cd346 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:50.199805 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9aa84-aab0-4935-9bb3-4dee985cd346 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:50.204549 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d2e76-b06c-4acb-8c56-6443af03ccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:50.205221 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2e76-b06c-4acb-8c56-6443af03ccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:50.205539 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2e76-b06c-4acb-8c56-6443af03ccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:50.205817 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2e76-b06c-4acb-8c56-6443af03ccd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:50.206560 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d2e76-b06c-4acb-8c56-6443af03ccd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:50.208162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d2e76-b06c-4acb-8c56-6443af03ccd6 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:50.219324 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1418/2865] 10.222.0.69 () {58 vars in 1121 bytes} [Wed May 4 14:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:13:50.223165 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a21d-7a16-447a-b3ae-d545663990be admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:50.233589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a21d-7a16-447a-b3ae-d545663990be admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:50.238295 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:50.239546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:50.239546 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:50.239772 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] PATH_INFO: `/v3/projects/653503f4f21b47e8984726436e9e370d/users/0d0d8b979b234f8881f91f9c2e557375/roles/68f91fa718f44020a307be6b2f10b834` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:50.255958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653503f4f21b47e8984726436e9e370d, user_id=0d0d8b979b234f8881f91f9c2e557375, role_id=68f91fa718f44020a307be6b2f10b834)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:50.258666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:50.354728 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1448/2866] 10.222.0.69 () {60 vars in 1482 bytes} [Wed May 4 14:13:50 2022] PUT /identity/v3/projects/653503f4f21b47e8984726436e9e370d/users/0d0d8b979b234f8881f91f9c2e557375/roles/68f91fa718f44020a307be6b2f10b834 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:50.365368 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937563-042a-48de-bb53-f9b5006ddd57 None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:50.365668 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937563-042a-48de-bb53-f9b5006ddd57 None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:50.365975 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937563-042a-48de-bb53-f9b5006ddd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:50.423622 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-bb937563-042a-48de-bb53-f9b5006ddd57 None None] MFA Rules not processed for user `0d0d8b979b234f8881f91f9c2e557375`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:50.424827 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bb937563-042a-48de-bb53-f9b5006ddd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:50.488176 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1419/2867] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:50.500018 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:50.501827 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:50.559634 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307279e-c40b-40d5-99f5-215d0533daf8 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:50.563258 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb09e9-2228-4b5f-aef3-009e0b21b800 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d96159b7fb49c08b1f5c014d26f79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:50.563929 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb09e9-2228-4b5f-aef3-009e0b21b800 service glance] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:50.564215 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb09e9-2228-4b5f-aef3-009e0b21b800 service glance] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:50.564495 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb09e9-2228-4b5f-aef3-009e0b21b800 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:50.573369 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb09e9-2228-4b5f-aef3-009e0b21b800 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:50.574860 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb09e9-2228-4b5f-aef3-009e0b21b800 service glance] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:50.584145 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1449/2868] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:56.097147 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937563-042a-48de-bb53-f9b5006ddd57 None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:56.098788 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-bb937563-042a-48de-bb53-f9b5006ddd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:56.155934 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937563-042a-48de-bb53-f9b5006ddd57 None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:56.159468 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:56.160167 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:56.160460 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:56.160739 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:56.162528 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:56.234467 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:56.236029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:56.248116 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1420/2869] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:56.909655 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb09e9-2228-4b5f-aef3-009e0b21b800 service glance] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:56.922475 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb09e9-2228-4b5f-aef3-009e0b21b800 service glance] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:56.929078 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2669a32-efb0-442f-ae10-f4906a200b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:56.930162 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669a32-efb0-442f-ae10-f4906a200b1e service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:56.933699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669a32-efb0-442f-ae10-f4906a200b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:56.933699 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669a32-efb0-442f-ae10-f4906a200b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:56.934067 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-b2669a32-efb0-442f-ae10-f4906a200b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:56.954925 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2669a32-efb0-442f-ae10-f4906a200b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:56.956808 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2669a32-efb0-442f-ae10-f4906a200b1e service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:56.974006 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1450/2870] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:58.137740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:58.139496 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:58.216008 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0224693-506a-4a44-9401-0e53d8750fb5 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:58.220939 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:58.221915 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:58.222195 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:58.222471 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] PATH_INFO: `/v3/users/e303f04aa824459fa119003dd6ccdc33` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:58.223918 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e303f04aa824459fa119003dd6ccdc33)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:58.225887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:58.441945 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e303f04aa824459fa119003dd6ccdc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:58.454920 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e303f04aa824459fa119003dd6ccdc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:58.455810 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e303f04aa824459fa119003dd6ccdc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:58.456591 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e303f04aa824459fa119003dd6ccdc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:58.531740 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e303f04aa824459fa119003dd6ccdc33'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:58.558029 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1421/2871] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:13:58 2022] DELETE /identity/v3/users/e303f04aa824459fa119003dd6ccdc33 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:13:58.563082 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1614b-910e-4322-8081-571521ab956f None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:58.563589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1614b-910e-4322-8081-571521ab956f None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:58.563687 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1614b-910e-4322-8081-571521ab956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:58.585013 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-18b1614b-910e-4322-8081-571521ab956f None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:13:58.586312 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-18b1614b-910e-4322-8081-571521ab956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:58.664236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1451/2872] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:13:58.674789 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:58.676251 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:58.765198 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d4c81-bec7-464c-a103-f97e713bf845 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:58.767425 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:58.768479 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:58.768752 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:58.768881 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:58.781685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:58.783149 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:58.794987 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1422/2873] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:13:59.287394 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1614b-910e-4322-8081-571521ab956f None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:13:59.288943 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-18b1614b-910e-4322-8081-571521ab956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:13:59.310817 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1614b-910e-4322-8081-571521ab956f None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:13:59.315696 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:13:59.316796 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:13:59.317075 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:13:59.317586 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] PATH_INFO: `/v3/projects/0a98baf533d141d5b8e7716a77fc8b04` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:13:59.318979 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a98baf533d141d5b8e7716a77fc8b04)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:13:59.320888 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:13:59.468572 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a98baf533d141d5b8e7716a77fc8b04', 'request_id': 'req-19e667a1-9ea5-4b1c-bad9-7a195b742f62'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:59.553656 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a98baf533d141d5b8e7716a77fc8b04', 'request_id': 'req-19e667a1-9ea5-4b1c-bad9-7a195b742f62'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:59.560176 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a98baf533d141d5b8e7716a77fc8b04', 'request_id': 'req-19e667a1-9ea5-4b1c-bad9-7a195b742f62'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:59.575076 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] The token cache is being invalidate because project 0a98baf533d141d5b8e7716a77fc8b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:13:59.575685 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:59.576254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:13:59.578097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1452/2874] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:13:59 2022] DELETE /identity/v3/projects/0a98baf533d141d5b8e7716a77fc8b04 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:14:14.663155 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:14.664635 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:14.723150 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678aa9b-c144-475d-80fc-f04dd0e23e64 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:14.784790 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c8fda-e1fb-4a8f-b7a8-99f745700bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec9c893558b74cf89012a50734d06ca1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:14.785522 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8fda-e1fb-4a8f-b7a8-99f745700bef service cinder] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:14.785803 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8fda-e1fb-4a8f-b7a8-99f745700bef service cinder] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:14.786105 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c8fda-e1fb-4a8f-b7a8-99f745700bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:14.787955 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c11c8fda-e1fb-4a8f-b7a8-99f745700bef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:14.861960 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c8fda-e1fb-4a8f-b7a8-99f745700bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:14.863429 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c8fda-e1fb-4a8f-b7a8-99f745700bef service cinder] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:14.874958 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1423/2875] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:14:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:14:21.721399 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:21.722926 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:21.739193 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e667a1-9ea5-4b1c-bad9-7a195b742f62 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:21.745105 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:21.745790 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:21.746079 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:21.746407 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:21.748260 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:21.762107 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:21.763746 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:21.775602 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1453/2876] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:14:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:14:23.803449 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72402d7-074a-464e-855b-862b00f5745c None None] REQUEST_METHOD: `POST` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:23.803929 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72402d7-074a-464e-855b-862b00f5745c None None] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:23.804040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72402d7-074a-464e-855b-862b00f5745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:23.821611 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.auth.core [None req-a72402d7-074a-464e-855b-862b00f5745c None None] MFA Rules not processed for user `d58026a187ef48d69fa18853db63cd43`. Rule list: `[]` (Enabled: `True`). {{(pid=91848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:14:23.823323 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a72402d7-074a-464e-855b-862b00f5745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:23.878466 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1424/2877] 10.222.0.69 () {58 vars in 967 bytes} [Wed May 4 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:14:23.891765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:23.893199 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:23.964574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871c02b-873d-49b0-bce6-c8f9717207ff service nova] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:23.969587 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea24e52-f4c6-48a7-b279-33125204451a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52aa32e8c0f742659725ddec932014b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:23.970225 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24e52-f4c6-48a7-b279-33125204451a service swift] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:23.970505 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24e52-f4c6-48a7-b279-33125204451a service swift] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:23.970779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24e52-f4c6-48a7-b279-33125204451a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:23.978823 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea24e52-f4c6-48a7-b279-33125204451a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:23.980446 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea24e52-f4c6-48a7-b279-33125204451a service swift] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:23.988646 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1454/2878] 10.222.0.69 () {60 vars in 1384 bytes} [Wed May 4 14:14:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 14:14:27.350748 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72402d7-074a-464e-855b-862b00f5745c None None] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:27.352458 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-a72402d7-074a-464e-855b-862b00f5745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:27.424696 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72402d7-074a-464e-855b-862b00f5745c None None] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:27.430245 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:27.431284 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:27.432042 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:27.432408 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] PATH_INFO: `/v3/users/0d0d8b979b234f8881f91f9c2e557375` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:27.433736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d0d8b979b234f8881f91f9c2e557375)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:27.435677 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:27.649685 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d0d8b979b234f8881f91f9c2e557375'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:27.662970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d0d8b979b234f8881f91f9c2e557375'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:27.663712 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d0d8b979b234f8881f91f9c2e557375'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:27.664322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d0d8b979b234f8881f91f9c2e557375'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:27.787293 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d0d8b979b234f8881f91f9c2e557375'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:27.805736 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1425/2879] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:14:27 2022] DELETE /identity/v3/users/0d0d8b979b234f8881f91f9c2e557375 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:14:27.810533 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bcb5b-1dfc-4e3c-93fb-5fb3e34f8b12 None None] REQUEST_METHOD: `POST` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:27.811026 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bcb5b-1dfc-4e3c-93fb-5fb3e34f8b12 None None] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:27.811130 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bcb5b-1dfc-4e3c-93fb-5fb3e34f8b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:27.830236 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.auth.core [None req-308bcb5b-1dfc-4e3c-93fb-5fb3e34f8b12 None None] MFA Rules not processed for user `52cc28158c3e43a08acacdddef40ed48`. Rule list: `[]` (Enabled: `True`). {{(pid=91849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:14:27.831463 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-308bcb5b-1dfc-4e3c-93fb-5fb3e34f8b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:27.903139 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1455/2880] 10.222.0.69 () {58 vars in 957 bytes} [Wed May 4 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:14:27.914098 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:27.916806 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:27.979327 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bc121-73ca-4da0-bfed-6f9bdda9a511 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:27.986403 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:27.986969 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:27.987480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:27.987772 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:28.003045 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:28.004497 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:28.016859 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1426/2881] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:14:28.691731 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bcb5b-1dfc-4e3c-93fb-5fb3e34f8b12 None None] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:28.693450 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-308bcb5b-1dfc-4e3c-93fb-5fb3e34f8b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:28.712920 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bcb5b-1dfc-4e3c-93fb-5fb3e34f8b12 None None] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:28.725096 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:28.726733 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:28.727241 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:28.727714 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] PATH_INFO: `/v3/projects/653503f4f21b47e8984726436e9e370d` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:28.729654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=653503f4f21b47e8984726436e9e370d)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:28.731954 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:28.886408 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653503f4f21b47e8984726436e9e370d', 'request_id': 'req-4b6d3dba-0906-408d-bbf9-e56949e621fa'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:28.964517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653503f4f21b47e8984726436e9e370d', 'request_id': 'req-4b6d3dba-0906-408d-bbf9-e56949e621fa'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:28.971254 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653503f4f21b47e8984726436e9e370d', 'request_id': 'req-4b6d3dba-0906-408d-bbf9-e56949e621fa'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:28.985454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] The token cache is being invalidate because project 653503f4f21b47e8984726436e9e370d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:14:28.985454 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:28.986436 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:28.988787 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1456/2882] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:14:28 2022] DELETE /identity/v3/projects/653503f4f21b47e8984726436e9e370d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:14:33.228480 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:33.229970 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:33.244819 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d8e4-c4f1-4fcb-8ea6-cb3966e8ac81 service neutron] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:33.302742 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:33.303613 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:33.303903 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:33.304181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] PATH_INFO: `/v3/users/bc34505203634f36af6ef486b5ac598d` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:33.307124 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc34505203634f36af6ef486b5ac598d)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:33.312343 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:33.549639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc34505203634f36af6ef486b5ac598d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:33.561529 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc34505203634f36af6ef486b5ac598d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:33.562216 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc34505203634f36af6ef486b5ac598d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:33.562879 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc34505203634f36af6ef486b5ac598d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:33.638889 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc34505203634f36af6ef486b5ac598d'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:33.653003 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1427/2883] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:14:33 2022] DELETE /identity/v3/users/bc34505203634f36af6ef486b5ac598d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:14:33.880654 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:33.882233 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:33.896125 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d3dba-0906-408d-bbf9-e56949e621fa admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:33.953658 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:33.954525 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:33.954806 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:33.955099 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] PATH_INFO: `/v3/projects/4e3df9d7b8b4443aabe77cf4a5e4b549` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:33.956320 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3df9d7b8b4443aabe77cf4a5e4b549)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:33.958280 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:34.148930 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3df9d7b8b4443aabe77cf4a5e4b549', 'request_id': 'req-fdeff384-514d-47a1-860c-34530db6b48e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.244793 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3df9d7b8b4443aabe77cf4a5e4b549', 'request_id': 'req-fdeff384-514d-47a1-860c-34530db6b48e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.250668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3df9d7b8b4443aabe77cf4a5e4b549', 'request_id': 'req-fdeff384-514d-47a1-860c-34530db6b48e'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.262661 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] The token cache is being invalidate because project 4e3df9d7b8b4443aabe77cf4a5e4b549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:14:34.262950 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.263589 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.265121 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1457/2884] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:14:33 2022] DELETE /identity/v3/projects/4e3df9d7b8b4443aabe77cf4a5e4b549 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:14:34.269188 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:34.270637 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:34.283917 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af859b6e-5846-4ba2-bd88-a055d8b60a59 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:34.339181 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:34.340046 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:34.340322 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:34.340598 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] PATH_INFO: `/v3/users/81f21f0bcebd4246bf3db7d524b7dd54` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:34.341823 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f21f0bcebd4246bf3db7d524b7dd54)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:34.343727 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:34.562009 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f21f0bcebd4246bf3db7d524b7dd54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.574225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f21f0bcebd4246bf3db7d524b7dd54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.574925 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f21f0bcebd4246bf3db7d524b7dd54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.575538 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f21f0bcebd4246bf3db7d524b7dd54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.661961 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f21f0bcebd4246bf3db7d524b7dd54'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:34.674749 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1428/2885] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:14:34 2022] DELETE /identity/v3/users/81f21f0bcebd4246bf3db7d524b7dd54 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:14:34.974635 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:14:34.976574 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:14:34.992403 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeff384-514d-47a1-860c-34530db6b48e admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:14:35.052001 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:14:35.052859 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:14:35.053144 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:14:35.053451 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] PATH_INFO: `/v3/projects/d392c091076e4444801a9c6d31c7d6ac` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:14:35.054666 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d392c091076e4444801a9c6d31c7d6ac)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:14:35.056765 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:14:35.165267 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd392c091076e4444801a9c6d31c7d6ac', 'request_id': 'req-788fd85f-7087-4725-ae52-7b7666ee6b06'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:35.233212 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd392c091076e4444801a9c6d31c7d6ac', 'request_id': 'req-788fd85f-7087-4725-ae52-7b7666ee6b06'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:35.238966 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd392c091076e4444801a9c6d31c7d6ac', 'request_id': 'req-788fd85f-7087-4725-ae52-7b7666ee6b06'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:35.250445 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] The token cache is being invalidate because project d392c091076e4444801a9c6d31c7d6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:14:35.250726 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:35.251364 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:14:35.252891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1458/2886] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:14:34 2022] DELETE /identity/v3/projects/d392c091076e4444801a9c6d31c7d6ac => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:15:02.718616 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:15:02.720558 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:15:02.866487 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa8447-5fb3-4cde-8bdf-5c929c247463 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:15:02.932376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6da21ec482e47399411baa3c33f4f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:15:02.933040 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:15:02.933346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:15:02.933623 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:15:02.935406 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:15:02.949540 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:15:02.951866 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:15:02.964276 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1429/2887] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:15:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:15:18.954662 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:15:18.956191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:15:19.044891 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd85f-7087-4725-ae52-7b7666ee6b06 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:15:19.048543 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bf86fc54142ee85dc16cce3664978', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:15:19.049191 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] REQUEST_METHOD: `GET` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:15:19.049501 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:15:19.049780 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:15:19.051609 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:15:19.139880 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:15:19.141668 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:15:19.160895 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1459/2888] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:15:26.839585 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:15:26.841228 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:15:26.855184 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc5569-05c6-404d-8c97-745872018ee0 service nova] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:15:26.859830 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:15:26.860690 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:15:26.860993 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:15:26.861287 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] PATH_INFO: `/v3/users/4290947cee5b49dda7f75d4656d4e834` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:15:26.862499 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4290947cee5b49dda7f75d4656d4e834)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:15:26.864411 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:15:27.104949 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4290947cee5b49dda7f75d4656d4e834'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.116844 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4290947cee5b49dda7f75d4656d4e834'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.117709 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4290947cee5b49dda7f75d4656d4e834'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.118510 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4290947cee5b49dda7f75d4656d4e834'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.204445 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4290947cee5b49dda7f75d4656d4e834'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.218106 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1430/2889] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:15:26 2022] DELETE /identity/v3/users/4290947cee5b49dda7f75d4656d4e834 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:15:27.480804 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:15:27.491538 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb1c50-0531-451f-9b44-1c2a3ecf0895 service neutron] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:15:27.550755 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:15:27.551626 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:15:27.551909 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:15:27.552184 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] PATH_INFO: `/v3/projects/1625f082167647399a6211547163cb93` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:15:27.553405 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1625f082167647399a6211547163cb93)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:15:27.555304 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:15:27.656097 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1625f082167647399a6211547163cb93', 'request_id': 'req-d6249b71-d009-4a11-8405-185761642ef6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.700811 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1625f082167647399a6211547163cb93', 'request_id': 'req-d6249b71-d009-4a11-8405-185761642ef6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.706779 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1625f082167647399a6211547163cb93', 'request_id': 'req-d6249b71-d009-4a11-8405-185761642ef6'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.719024 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] The token cache is being invalidate because project 1625f082167647399a6211547163cb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:15:27.719313 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.719956 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:27.721536 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1460/2890] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:15:27 2022] DELETE /identity/v3/projects/1625f082167647399a6211547163cb93 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:15:27.725639 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:15:27.726964 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:15:27.740979 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9cf82-a137-407c-8063-97f039b39167 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:15:27.798733 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:15:27.799602 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:15:27.799887 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:15:27.800162 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] PATH_INFO: `/v3/users/0e8ae8e8db6c45e280282f600af05854` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:15:27.801400 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8ae8e8db6c45e280282f600af05854)` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:15:27.803306 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:15:27.990222 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8ae8e8db6c45e280282f600af05854'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.003678 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8ae8e8db6c45e280282f600af05854'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.004372 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8ae8e8db6c45e280282f600af05854'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.005005 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8ae8e8db6c45e280282f600af05854'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.084100 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.notifications [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8ae8e8db6c45e280282f600af05854'} {{(pid=91848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.097785 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1431/2891] 10.222.0.69 () {58 vars in 1223 bytes} [Wed May 4 14:15:27 2022] DELETE /identity/v3/users/0e8ae8e8db6c45e280282f600af05854 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:15:28.372497 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] Authenticating user token {{(pid=91849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:15:28.373961 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.fernet_utils [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:15:28.387517 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6249b71-d009-4a11-8405-185761642ef6 admin admin] Validating token access rules against request {{(pid=91849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:15:28.456237 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52cc28158c3e43a08acacdddef40ed48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3182e031164ef9b9b514b600f7699c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:15:28.457113 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:15:28.457432 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:15:28.457708 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] PATH_INFO: `/v3/projects/aa556b788bd248e5ae368d0e57530638` {{(pid=91849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:15:28.459110 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa556b788bd248e5ae368d0e57530638)` {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:15:28.461041 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] RBAC: Authorization granted {{(pid=91849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:15:28.593524 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa556b788bd248e5ae368d0e57530638', 'request_id': 'req-524502d0-d136-478e-a9b0-47086d0a2645'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.667008 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa556b788bd248e5ae368d0e57530638', 'request_id': 'req-524502d0-d136-478e-a9b0-47086d0a2645'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.673433 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa556b788bd248e5ae368d0e57530638', 'request_id': 'req-524502d0-d136-478e-a9b0-47086d0a2645'} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.685487 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] The token cache is being invalidate because project aa556b788bd248e5ae368d0e57530638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:15:28.685773 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.686413 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: DEBUG keystone.notifications [None req-524502d0-d136-478e-a9b0-47086d0a2645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:15:28.687958 dv-cinder-836996-12-iscsi devstack@keystone.service[91849]: [pid: 91849|app: 0|req: 1461/2892] 10.222.0.69 () {58 vars in 1232 bytes} [Wed May 4 14:15:28 2022] DELETE /identity/v3/projects/aa556b788bd248e5ae368d0e57530638 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:17:34.640808 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] Authenticating user token {{(pid=91848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:17:34.642346 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:17:34.734991 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f396cda-617b-4e16-97f9-37f2303ce9c2 admin admin] Validating token access rules against request {{(pid=91848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:17:34.794281 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9862ba-98c9-42b4-86e9-3844c4c3455c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06ffd2170c2243eab4511fced8d67ab1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26c0839f91454b2b94072b6107d12a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:17:34.794938 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9862ba-98c9-42b4-86e9-3844c4c3455c service placement] REQUEST_METHOD: `GET` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:17:34.795225 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9862ba-98c9-42b4-86e9-3844c4c3455c service placement] SCRIPT_NAME: `/identity` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:17:34.795506 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9862ba-98c9-42b4-86e9-3844c4c3455c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:17:34.797325 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.fernet_utils [None req-8d9862ba-98c9-42b4-86e9-3844c4c3455c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:17:34.808758 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9862ba-98c9-42b4-86e9-3844c4c3455c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:17:34.810376 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9862ba-98c9-42b4-86e9-3844c4c3455c service placement] RBAC: Authorization granted {{(pid=91848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:17:34.820197 dv-cinder-836996-12-iscsi devstack@keystone.service[91848]: [pid: 91848|app: 0|req: 1432/2893] 10.222.0.69 () {60 vars in 1365 bytes} [Wed May 4 14:17:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)